-- Logs begin at Thu 2022-07-21 07:47:45 UTC, end at Thu 2022-07-21 08:55:04 UTC. -- Jul 21 08:21:12.381992 dv-cinder-850320-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 08:21:12.392418 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 08:21:12 2022] *** Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: nodename: dv-cinder-850320-1-iscsi Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: machine: x86_64 Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: clock source: unix Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: pcre jit disabled Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: detected number of CPU cores: 4 Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: current working directory: / Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: detected binary path: /usr/bin/uwsgi-core Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: your processes number limit is 47680 Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: your memory page size is 4096 bytes Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: detected max file descriptor number: 2048 Jul 21 08:21:12.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: lock engine: pthread robust mutexes Jul 21 08:21:12.395166 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: thunder lock: enabled Jul 21 08:21:12.395166 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 08:21:12.395166 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 08:21:12.438759 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: Python main interpreter initialized at 0x55f79bc289c0 Jul 21 08:21:12.438759 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: python threads support enabled Jul 21 08:21:12.438759 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: your server socket listen backlog is limited to 100 connections Jul 21 08:21:12.438759 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: your mercy for graceful operations on workers is 90 seconds Jul 21 08:21:12.439154 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 08:21:12.439154 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: *** Operational MODE: preforking *** Jul 21 08:21:12.439454 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: *** uWSGI is running in multiple interpreter mode *** Jul 21 08:21:12.439454 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: spawned uWSGI master process (pid: 103223) Jul 21 08:21:12.439663 dv-cinder-850320-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 08:21:12.440237 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: spawned uWSGI worker 1 (pid: 103224, cores: 1) Jul 21 08:21:12.440566 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: spawned uWSGI worker 2 (pid: 103225, cores: 1) Jul 21 08:21:12.440719 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 08:21:13.106871 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 08:21:13.107531 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 08:21:14.228645 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:21:14.228645 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: from cryptography.utils import int_from_bytes Jul 21 08:21:14.229396 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:21:14.229396 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: from cryptography.utils import int_from_bytes Jul 21 08:21:14.232311 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:21:14.232311 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: from cryptography.utils import int_from_bytes Jul 21 08:21:14.232785 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:21:14.232785 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: from cryptography.utils import int_from_bytes Jul 21 08:21:16.717043 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:21:16.717703 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:21:16.717815 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:21:16.718184 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:21:16.718380 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:21:16.718742 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:21:16.718828 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:21:16.718915 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.719149 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.719237 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:21:16.719511 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.719663 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:21:16.719827 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.719936 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:21:16.720332 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.720665 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.720772 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.720994 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.721090 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.721318 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.721412 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.721652 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.721745 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.721983 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.722130 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.722302 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.722410 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.722628 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.722733 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.722964 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-1-iscsi {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.723061 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.723215 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.723314 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.723559 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.723649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.723888 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-1-iscsi {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.723977 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.724216 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.724317 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.724527 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.724618 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.724848 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.724937 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.725158 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.725246 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.725465 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.725660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.725779 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.726802 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.726920 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.726920 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727043 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727129 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727205 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727277 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727367 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727435 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727513 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727751 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.727841 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.728002 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.728152 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.728318 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.728478 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.728648 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.728799 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.728966 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.729066 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.729380 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-1-iscsi {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.729474 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.729688 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.729781 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.730004 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.730100 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-1-iscsi {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.730325 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.730422 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.730716 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.730813 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.731034 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.731143 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.731400 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.731504 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.731732 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.731823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.732061 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.732208 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.732376 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.732519 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.732700 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.732850 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.733017 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.733160 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.733340 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.733482 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.733664 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.733805 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.733959 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.734101 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.734272 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.734419 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.734588 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.734738 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.734905 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.735053 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.735239 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.735416 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.735559 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.735696 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.735841 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.735985 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.736129 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.736264 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.736405 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.736539 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.736674 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.736821 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.736986 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.737138 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.737286 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.737431 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.737583 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.737734 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.737881 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.738019 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.738154 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.738336 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.738487 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.738624 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.738759 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.738894 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.739053 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.739256 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.739434 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.739578 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.739731 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.739948 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.740090 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.740240 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.740464 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.740607 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.740741 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.740884 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.741025 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.741174 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.741327 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.741464 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.741599 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.741742 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.741889 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.742025 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.742176 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.742311 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.742453 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.742595 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.742738 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.742883 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.743018 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.743162 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.743297 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.743482 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.743630 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.743777 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.743919 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.744064 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.744199 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.744346 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.744498 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.744641 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.744783 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.744927 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.745105 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.745262 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.745399 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.745533 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.745711 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.745853 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.746543 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.746697 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.746875 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.747018 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.747163 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.747304 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.747476 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.747629 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.747775 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.747909 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.748056 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.748199 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.748358 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.748518 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.748680 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.748822 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.748990 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.749132 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.749294 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.749545 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.749692 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.749828 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.749989 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.750201 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.750350 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.750488 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.750636 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.750773 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.750917 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.751060 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.751204 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.751371 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.751526 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.751670 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.751805 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.751941 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.752083 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.752227 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.752369 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.752514 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.752660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.752796 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.752942 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.753080 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.753215 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.753359 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.753493 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.753637 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.753807 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.753952 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.754124 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.754280 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.754424 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.754578 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.754725 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.754868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.755034 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.755186 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.755367 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.755509 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.755659 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.755795 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.755970 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.756111 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.756279 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.756428 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.756573 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.756709 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.756895 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.757048 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.757196 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.757349 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.757485 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.757620 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.757799 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.757948 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.758108 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.758515 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.758684 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.758826 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.758992 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.759134 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.759301 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.759499 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.759645 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.759788 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.759925 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.760058 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.760210 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.760429 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.760578 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.760715 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.760858 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.760999 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.761143 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.761280 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.761509 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.761785 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.762415 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.762552 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.762705 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.762853 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.762989 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.763124 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.763266 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.763430 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.763579 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.763716 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.763851 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:21:16.763996 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.764138 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.764275 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.764423 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.764561 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.764760 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.764909 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.765080 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.765231 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.765422 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.765584 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.765760 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.765924 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.766061 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.766204 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.766397 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.766567 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.766711 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.766858 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.766995 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.767138 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.767305 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.767506 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.767652 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.767797 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.767940 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.768076 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.768263 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.768429 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.768575 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.768713 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.768903 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.769053 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.769222 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.769363 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.769537 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.769687 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.769857 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.770007 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.770174 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.770324 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.770545 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.770696 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.770911 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.771061 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.771198 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.771364 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.771517 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.771654 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.771800 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.771957 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.772104 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.772241 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.772415 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.772559 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.772731 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.772875 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.773055 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.773199 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.773370 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.773518 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.773689 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.773833 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.774008 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.774152 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.774325 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.774478 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.774651 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.774794 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.774965 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.775107 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.775280 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.775475 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.775614 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.775754 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.775924 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.776075 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.776239 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.776389 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.776555 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.776697 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.776871 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.777015 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.777194 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.777344 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.777541 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.777685 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.777869 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.778031 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.778177 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.778318 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.778493 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.778636 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.778807 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.778949 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.779120 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.779265 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.779444 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.779583 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.779756 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.779907 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.780070 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.780207 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.780343 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.780479 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.780707 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.780850 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.780996 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.781193 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.781335 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.781471 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.781608 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.781743 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.781888 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.782034 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.782178 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.782317 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.782493 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.782654 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.782798 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.782935 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.783111 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.783254 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.783453 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.783614 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.783752 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.783898 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.784067 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.784218 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.784380 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.784530 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.784691 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.784834 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.785002 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.785150 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.785327 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.785479 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.785623 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.785761 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.785934 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.786079 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.786250 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.786392 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.786560 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.786710 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.786875 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.787017 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.787188 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.787382 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.787538 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.787687 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.787830 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.787981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.788126 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.788270 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.788449 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.788594 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.788768 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.788921 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.789084 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.789228 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.789405 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.789546 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.789736 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.789900 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.790045 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.790196 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.790355 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.790504 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.790740 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.790904 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.791043 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.791178 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.791313 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.791523 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.791667 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.791813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.791959 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.792094 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.792229 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.792363 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.792498 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.792646 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.792784 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.792919 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.793109 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.793251 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.793418 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.793560 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.793722 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.793875 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.794011 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.794146 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.794323 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.794466 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.794641 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.794783 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.794953 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.795095 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.795261 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.795442 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.795582 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.795716 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.795886 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.796044 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.796232 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.796382 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.796541 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.796691 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.796888 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.797039 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.797215 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.797355 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.797532 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.797676 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.797854 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.798020 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.798157 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.798291 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.798474 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.798621 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.798788 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.798941 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.799086 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.799221 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.799431 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.799575 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.799747 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.799964 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.800115 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.800257 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.800400 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.800536 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.800680 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.800833 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.801039 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.801189 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.801326 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.801463 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.801606 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.801751 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.801898 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.802042 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.802187 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.802322 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.802505 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.802656 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.802852 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.803002 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.803184 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.803359 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.803515 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.803651 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.803838 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.803997 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.804141 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.804285 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.804453 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.804596 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.804767 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.804907 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.805079 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.805229 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.805399 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.805554 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.805713 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.805853 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.806034 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.806193 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.806330 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.806482 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.806657 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.806798 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.806968 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.807117 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.807290 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.807475 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.807623 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.807760 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.807931 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.808093 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.808229 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.808363 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.809044 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.809196 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.809379 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.809526 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.809699 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.809841 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.810020 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.810176 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.810328 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.810480 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.810623 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.810766 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.810939 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.811176 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.811364 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.811514 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.811657 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.811800 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.811943 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.812086 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.812239 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.812383 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.812539 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.812683 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.812825 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.812980 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.813124 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.813267 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.813409 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.813551 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.813699 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.813851 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.813995 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.814136 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.814285 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.814439 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.814587 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.814738 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.814882 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.815024 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.815166 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.815319 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.815516 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.815671 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.815817 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.815960 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.816112 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.816261 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.816430 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.816579 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.816727 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.816871 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.817013 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.817161 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.817312 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.817455 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.817603 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.817745 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.817910 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.818081 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.818233 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.818393 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.818549 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.818694 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.818836 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.818978 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.819128 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.819272 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.819445 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.819588 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.819770 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.819940 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.820085 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.820227 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.820380 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.820523 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.820701 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.820865 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.821009 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.821169 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.821381 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.821547 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.821698 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.821850 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.822005 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.822150 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.822302 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.822443 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.822585 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.822735 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.822885 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.823029 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.823171 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.823312 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.823528 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.823674 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.823822 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.823965 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.824106 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.824822 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.824980 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.825131 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.825282 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.825425 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.825567 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.825709 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.825933 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.826122 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.826274 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.826462 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.826784 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.826932 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.827103 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.827248 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.827432 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.827581 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.827759 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.827919 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.828097 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.828246 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.828420 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.828568 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.828758 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.828917 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.829146 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.829303 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.829448 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.829597 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.829748 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.829900 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.830044 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.830188 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.830339 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.830492 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.830635 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.830784 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.830928 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.831093 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.831237 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.831428 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.831579 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.831722 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.831864 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.832022 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.832165 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.832307 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.832458 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.832603 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.832745 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.832895 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.833048 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.833199 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.833342 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.833491 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.833642 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.833798 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.833942 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.834091 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.834233 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.834383 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.834526 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.834677 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.834821 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.834973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.835115 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.835264 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.835449 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.835594 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.835737 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.835879 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.836027 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.836180 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.836331 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.836476 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.836617 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.836770 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.836954 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.837111 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.837264 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.837408 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.837550 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.837699 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.837875 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.838034 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.838178 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.838326 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.838505 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.838649 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.838808 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.838966 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.839116 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.839292 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.839496 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.839640 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.839804 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.839969 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.840113 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.840255 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.840403 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.840553 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.840696 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.840856 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.841007 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.841150 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.841297 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.841440 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.841620 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.841723 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.841809 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.841893 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.842123 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.842283 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.842436 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.842592 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.842734 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.842874 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.843016 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.843167 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.843319 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.843494 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.843637 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.843790 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.843933 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.844075 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.844226 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.844369 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.844521 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.844671 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.844821 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.844972 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.845115 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.845265 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.845408 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.845550 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.845717 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.845875 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.846025 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.846168 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.846311 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.846472 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.846616 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.846773 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.846916 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.847058 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.847199 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.847395 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.847551 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.847712 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.847863 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.848006 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.848147 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.848289 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.848450 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.848600 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.848750 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.848892 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.849034 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.849176 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.849326 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.849470 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.849613 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.849754 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.849895 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.850037 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.850213 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.850373 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.850517 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.850659 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.850806 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.850949 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.851099 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.851242 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.851424 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.851579 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.851722 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.851884 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.852028 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.852179 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.852322 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.852464 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.852606 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.852824 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.852970 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.853113 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.853255 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.853397 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.853539 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.853693 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.853837 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.853978 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.854130 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.854280 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.854423 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.854573 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.854724 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.854866 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.855008 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.855150 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.855299 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.855988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.856133 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.856275 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.856451 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.856612 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.856763 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.856907 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.857048 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.857191 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.857372 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.857528 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.857682 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.857835 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.857984 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.858127 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.858276 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.858426 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.858588 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.858731 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.858874 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.859022 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.859187 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.859386 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.859547 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.859698 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.859843 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.859984 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.860126 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.860275 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.860419 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.860571 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.860713 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.860855 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.861005 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.861156 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.861329 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.861479 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.861654 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.861812 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.861957 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.862108 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.862258 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.862472 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.862630 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.862773 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.862915 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.863070 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.863214 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.863398 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.863558 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.863700 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.863851 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.863993 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.864136 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.864277 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.864429 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.864572 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.864730 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.864881 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.865023 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.865166 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.865314 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.865456 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.865607 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.865750 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.865892 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.866034 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.866177 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.866332 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.866483 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.866626 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.866768 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.866910 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.867075 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.867234 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.867400 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.867554 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.867701 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.867844 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.867998 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.868150 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.868305 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.868447 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.868597 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.868765 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.869008 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.869166 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.869311 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.869454 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.869625 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.869775 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.869918 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.870069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.870229 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.870372 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.870514 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.870657 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.870832 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.871002 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.871750 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.871894 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.872048 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.872199 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.872416 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.872570 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.872735 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.872901 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.873045 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.873187 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.873337 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.873489 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.873632 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.873780 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.873930 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.874079 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.874230 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.874373 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.874523 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.874667 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.874826 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.874978 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.875121 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.875264 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.875439 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.875584 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.875752 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.875914 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.876064 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.876208 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.876376 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.876526 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.876795 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.876962 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.877106 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.877248 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.877390 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.877533 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.877808 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.877967 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.878120 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.878275 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.878418 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.878560 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.878733 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.878894 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.879059 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.879216 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.879407 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.879585 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.879738 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.879883 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.880033 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.880177 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.880326 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.880469 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.880612 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.880754 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.880916 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.881059 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.881201 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.881344 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.881522 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.881679 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.881833 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.881985 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.882128 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.882271 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.882460 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.882624 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.882778 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.882942 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.883087 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.883533 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.883738 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.883900 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.884055 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.884200 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.884367 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.884519 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.884692 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.884852 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.885024 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.885194 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.885347 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.885492 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.885635 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.885786 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.885931 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.886075 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.886224 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.886381 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.886525 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.886705 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.886858 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.887016 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.887172 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.887357 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.887521 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.887667 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.887810 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.887959 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.888102 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.888255 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.888407 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.888557 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.888701 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.888845 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.888988 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.889148 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.889302 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.889446 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.889590 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.889733 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.889883 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.890026 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.890182 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.890328 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.890498 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.890648 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.890792 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.890942 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.891108 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.891259 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.891437 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.891583 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.891726 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.891881 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.892026 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.892169 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.892311 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.892455 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.892649 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.892847 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.893011 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.893156 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.893300 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.893444 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.893587 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.893738 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.893889 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.894034 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.894177 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.894320 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.894517 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.894668 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.894845 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.895008 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.895151 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.895294 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.895521 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.895668 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.895811 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.895954 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.896096 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.896246 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.896397 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.896543 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.896685 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.896835 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.896996 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.897146 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.897298 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.897448 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.897593 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.897743 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.897887 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.898038 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.898181 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.898333 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.898484 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.898630 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.898783 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.898941 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.899086 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.899229 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.899392 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.899541 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.899685 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.899907 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.900053 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.900197 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.900340 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.900483 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.900625 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.900788 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.900941 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.901086 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.901236 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.901388 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.901540 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.901684 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.901828 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.901971 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.902114 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.902293 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.902451 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.902627 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.902794 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.902962 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.903113 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.903286 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.903515 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.903662 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.903805 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.903949 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.904092 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.904241 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.904402 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.904568 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.904719 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.904873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.905017 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.905196 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.905348 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.905513 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.905663 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.905806 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.905947 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.906151 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.906309 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.906467 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.906612 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.906755 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.906995 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.907279 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.907475 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.907638 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.907737 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.907957 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.908057 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.908274 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.908365 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.908592 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.908702 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.908905 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.909004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.909221 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.909309 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.909535 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.909623 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.909848 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.909944 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.910163 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.910259 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.910476 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.910563 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.910807 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.910932 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.911137 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.911244 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.911499 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.911590 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.911823 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.911914 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.912145 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.912241 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.912467 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.912557 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.912787 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.912886 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.913110 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.913209 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.913460 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.913564 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.913771 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.913860 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.914081 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.914168 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.914400 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.914500 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.914716 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.914804 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.915028 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.915117 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.915363 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.915525 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.915672 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.915827 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.915980 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.916124 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.916276 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.916429 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.916576 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.916737 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.916891 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.917044 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.917197 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.917343 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.917510 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.917660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.917839 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.918521 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.918669 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.918811 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.918962 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.919117 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.919283 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.919463 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.919636 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.919787 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.919953 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.920158 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.920477 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.920638 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.920783 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.920926 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.921105 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.921257 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.921419 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.921572 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.921745 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.921894 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.922063 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.922211 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.922366 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.922515 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.922690 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.922840 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.922990 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.923138 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.923290 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.923494 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.923638 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.923781 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.923925 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.924078 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.924235 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.924379 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.924534 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.924682 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.924832 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.924977 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.925128 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.925283 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.925435 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.925585 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.925728 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.925982 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.926232 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.926383 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.926596 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.926746 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.926920 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.927083 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.927255 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.927439 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.927595 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.927736 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.927913 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.928073 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.928239 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.928387 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.928544 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.928687 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.928837 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.928989 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.929134 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.929277 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.929451 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.929611 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.929763 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.929908 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.930059 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.930204 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.930354 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.930496 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.930648 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.930799 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.930943 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.931086 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.931236 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.931410 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.931579 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.931724 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.931867 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.932011 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.932176 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.932340 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.932484 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.932627 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.932782 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.932926 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.933075 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.933227 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.933388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.934119 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.934271 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.934422 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.934574 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.934726 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.934877 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.935032 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.935176 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.935319 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.935491 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.935646 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.935790 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.935951 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.936102 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.936245 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.936389 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.936544 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.936695 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.936840 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.936983 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.937125 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.937346 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.937493 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.937643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.937786 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.937940 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.938083 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.938234 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.938378 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.938560 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.938708 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.938851 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.938994 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.939145 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.939367 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.939520 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.939665 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.939807 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.939971 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.940123 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.940266 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.940410 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.940553 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.940696 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.940902 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.941113 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.941271 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.941455 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.941611 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.941781 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.941951 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.942118 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.942269 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.942454 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.942604 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.942756 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.942908 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.943052 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.943202 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.943375 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.943537 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.943682 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.943834 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.943994 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.944138 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.944281 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.944424 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.944581 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.944726 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.944894 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.945050 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.945196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.945339 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.945491 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.945635 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.945788 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.945945 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.946096 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.946240 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.946400 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.946544 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.946688 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.946831 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.947001 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.947164 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.947309 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.947521 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.947673 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.947835 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.947980 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.948132 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.948284 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.948429 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.948572 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.948715 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.948858 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.949009 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.949222 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.949382 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.949536 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.949693 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.949847 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.949992 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.950143 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.950287 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.950430 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.950581 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.950739 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.950884 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.951035 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.951186 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.951389 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.951546 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.951716 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.951867 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.952017 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.952235 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.952416 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.952575 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.952727 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.952871 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.953041 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.953193 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.953367 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.953525 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.953680 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.953831 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.953981 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.954131 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.954304 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.954468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.954615 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.954759 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.954931 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.955081 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.955240 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.955424 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.955581 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.955725 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.955921 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.956073 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.956255 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.956407 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.956590 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.956750 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.956901 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.957046 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.957197 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.957349 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.957495 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.957648 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.957791 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.957947 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.958091 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.958234 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.958399 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.958551 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.958694 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.958846 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.958991 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.959142 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.959285 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.959462 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.959616 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.959729 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.959926 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.960018 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.960234 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.960322 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.960538 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.960635 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.960844 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.960931 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.961193 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.961302 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.961457 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.961612 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.961757 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.961898 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.962042 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.962192 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.962344 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.962487 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.962631 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.962774 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.962917 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.963067 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.963218 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.963498 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.963651 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.963795 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.963938 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.964081 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.964235 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.964380 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.964522 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.964664 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.964845 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.965000 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.965144 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.965286 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.965439 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.965582 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.965725 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.965948 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.966095 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.966238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.966380 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.966523 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.966672 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.966832 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.966983 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.967128 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.967270 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.967455 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.967599 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.967757 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.967902 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.968045 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.968187 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.968330 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.968508 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.968659 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.968824 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.968982 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.969127 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.969292 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.969446 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.969591 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.969735 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.969878 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.970022 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.970165 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.970353 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.970504 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.970655 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.970798 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.970976 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.971133 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.971288 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.971449 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.971640 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.971792 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.971960 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.972122 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.972267 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.972410 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.972579 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.972727 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.972895 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.973051 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.973207 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.973349 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.973492 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.973635 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.973791 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.973935 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.974109 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.974261 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.974411 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.974555 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.974728 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.974878 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.975032 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.975173 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.975375 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.975530 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.975686 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.975838 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.975982 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.976124 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.976299 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.976449 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.976601 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.976745 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.976928 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.977092 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.977258 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.977416 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.977588 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.977738 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.977912 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.978061 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.978241 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.978405 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.978580 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.978728 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.978900 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.979062 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.979205 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.979386 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.979543 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.979687 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.979830 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:21:16.979980 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:21:16.980133 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:21:17.045359 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Registered counter for database nova_api Jul 21 08:21:17.045538 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Registered counter for database nova_api Jul 21 08:21:17.159385 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:21:17.162556 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:21:17.165961 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:21:17.169573 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:21:17.222551 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.context [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ace4bd78-5500-4e99-9aa8-321e61ee020f(cell1) {{(pid=103224) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 08:21:17.226507 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:21:17.227736 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.context [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ace4bd78-5500-4e99-9aa8-321e61ee020f(cell1) {{(pid=103225) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 08:21:17.228147 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:21:17.228939 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:21:17.231634 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:21:17.232339 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:21:17.233629 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Registered counter for database nova_cell0 Jul 21 08:21:17.233960 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:21:17.234760 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:21:17.236916 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:21:17.237477 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Registered counter for database nova_cell1 Jul 21 08:21:17.238890 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Registered counter for database nova_cell0 Jul 21 08:21:17.242725 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Registered counter for database nova_cell1 Jul 21 08:21:17.245434 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:21:17.247679 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:21:17.249727 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:21:17.251627 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:21:17.253464 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:21:17.255982 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:21:17.391269 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:21:17.396448 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:21:17.401449 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Registered counter for database nova_cell0 Jul 21 08:21:17.407197 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Registered counter for database nova_cell0 Jul 21 08:21:17.410818 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:21:17.415239 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:21:17.416072 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:21:17.421017 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:21:17.752092 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 08:21:17.759884 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 08:21:17.762123 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 08:21:17.769543 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 08:21:18.100351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 08:21:18.106249 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 08:21:18.111469 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f79bc289c0 pid: 103224 (default app) Jul 21 08:21:18.113531 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:21:18.114704 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Jul 21 08:21:18.115120 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Thu Jul 21 08:21:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:21:18.115713 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 08:21:18.122351 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-f104c948-6722-45ea-adf6-0518f3fccdd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 08:21:18.127485 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f79bc289c0 pid: 103225 (default app) Jul 21 08:22:35.091826 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:35.092847 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 21 08:22:35.093240 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:22:35.109864 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:35.111917 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:35.113021 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell1:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:35.113879 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:35.998226 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-f84a6551-60e8-4c5a-939b-647c7ae5e700 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:36.030323 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-f84a6551-60e8-4c5a-939b-647c7ae5e700 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930350 Jul 21 08:22:36.039433 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Thu Jul 21 08:22:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:22:38.332720 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:38.334064 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-f7ae478c-be07-4103-8f19-cbb7a76141ea None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001775 Jul 21 08:22:38.339059 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:22:38.814265 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-0595b476-b6d3-4dcb-9f4a-9b8998f25ae3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "disk": 1}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:38.832651 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:38.832651 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 21 08:22:38.869408 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-0595b476-b6d3-4dcb-9f4a-9b8998f25ae3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528185 Jul 21 08:22:38.870091 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:22:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 08:22:39.088018 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-c99fd026-2da6-41fb-8121-7bb6572f0de0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:39.090474 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:39.090474 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 21 08:22:39.093240 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:39.094103 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell0:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:39.094836 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell1:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:39.095565 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:39.155886 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-c99fd026-2da6-41fb-8121-7bb6572f0de0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277541 Jul 21 08:22:39.156478 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 21 08:22:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:22:41.437071 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-0595b476-b6d3-4dcb-9f4a-9b8998f25ae3 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:41.438085 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-0595b476-b6d3-4dcb-9f4a-9b8998f25ae3 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 21 08:22:41.438940 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:22:42.128581 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-087763d4-62f2-4c4c-9fdf-86db55255fdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "swap": 0}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:42.146283 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:42.146283 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 21 08:22:42.167738 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-087763d4-62f2-4c4c-9fdf-86db55255fdb admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.722166 Jul 21 08:22:42.169254 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:22:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:22:42.182324 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-020dcc6f-65bf-4fcd-a804-045377a405a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:42.184256 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:22:42.184256 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 21 08:22:42.225659 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-020dcc6f-65bf-4fcd-a804-045377a405a6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047527 Jul 21 08:22:42.227776 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 21 08:22:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:22:44.538772 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-087763d4-62f2-4c4c-9fdf-86db55255fdb admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:44.539847 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-087763d4-62f2-4c4c-9fdf-86db55255fdb admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 21 08:22:44.548914 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:44 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:22:44.963273 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-c0f2e512-8c4d-4877-9e87-36ec53818999 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "id": "d2", "swap": 0, "ram": 1024}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:44.982347 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-c0f2e512-8c4d-4877-9e87-36ec53818999 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436491 Jul 21 08:22:44.982903 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:22:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 08:22:44.994475 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-1d8b63f4-cae9-401c-b43c-125fb0ce89ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:45.021868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-1d8b63f4-cae9-401c-b43c-125fb0ce89ed admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031046 Jul 21 08:22:45.022513 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 21 08:22:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:22:47.255221 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-c0f2e512-8c4d-4877-9e87-36ec53818999 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:47.256288 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-c0f2e512-8c4d-4877-9e87-36ec53818999 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 21 08:22:47.256692 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:22:47.700033 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-06e38421-1a88-49fb-bcbb-f13601dd0692 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "swap": 0}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:47.717758 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-06e38421-1a88-49fb-bcbb-f13601dd0692 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454438 Jul 21 08:22:47.718313 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:22:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:22:47.736651 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-dd0a6fbb-4f05-4f77-9045-252648a17444 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:47.774146 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-dd0a6fbb-4f05-4f77-9045-252648a17444 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042197 Jul 21 08:22:47.775313 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 21 08:22:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:22:50.036931 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-06e38421-1a88-49fb-bcbb-f13601dd0692 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:50.038506 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-06e38421-1a88-49fb-bcbb-f13601dd0692 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Jul 21 08:22:50.038951 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:22:50.483894 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a620ac47-2bb0-4e97-a893-81f8b30aa252 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "swap": 0, "id": "d4", "disk": 20}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:50.505525 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a620ac47-2bb0-4e97-a893-81f8b30aa252 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460819 Jul 21 08:22:50.506280 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:22:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:22:50.518994 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e1d12999-8df6-4b27-9343-cec0b467e5f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:50.542986 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e1d12999-8df6-4b27-9343-cec0b467e5f9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028059 Jul 21 08:22:50.543851 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Thu Jul 21 08:22:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:22:52.906015 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a620ac47-2bb0-4e97-a893-81f8b30aa252 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:52.907393 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a620ac47-2bb0-4e97-a893-81f8b30aa252 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Jul 21 08:22:52.907848 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:22:53.322534 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-a61c2ea3-7bb2-4ef5-837c-866253ad9cc6 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:53.345678 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-a61c2ea3-7bb2-4ef5-837c-866253ad9cc6 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.431684 Jul 21 08:22:53.346155 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Thu Jul 21 08:22:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:22:55.853955 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a620ac47-2bb0-4e97-a893-81f8b30aa252 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:55.855410 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a620ac47-2bb0-4e97-a893-81f8b30aa252 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Jul 21 08:22:55.855928 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:22:56.285500 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-64ca7ae2-f159-4468-b694-2bdb19b38110 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "id": "1", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:56.305138 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-64ca7ae2-f159-4468-b694-2bdb19b38110 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.443188 Jul 21 08:22:56.305759 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:22:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:22:56.319214 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-75c54225-392b-4350-abaa-b82ca66e7b9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:56.348972 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-75c54225-392b-4350-abaa-b82ca66e7b9a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034311 Jul 21 08:22:56.349985 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 21 08:22:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:22:58.604470 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-64ca7ae2-f159-4468-b694-2bdb19b38110 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:22:58.605475 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-64ca7ae2-f159-4468-b694-2bdb19b38110 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 21 08:22:58.605892 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:22:59.033427 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-e4a25b0c-84de-4751-a4a9-7f578bde11de admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:59.052652 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-e4a25b0c-84de-4751-a4a9-7f578bde11de admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.439816 Jul 21 08:22:59.053213 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:22:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 08:22:59.065345 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-4993a7ce-a365-4a49-8e73-0561dacf20fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:22:59.089677 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-4993a7ce-a365-4a49-8e73-0561dacf20fd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028009 Jul 21 08:22:59.090243 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 21 08:22:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:23:01.462176 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-e4a25b0c-84de-4751-a4a9-7f578bde11de admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:01.463689 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-e4a25b0c-84de-4751-a4a9-7f578bde11de admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Jul 21 08:23:01.464176 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:01.971663 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-21c5e019-069f-43b6-bd7c-d7a84e0f8b23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:01.990888 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-21c5e019-069f-43b6-bd7c-d7a84e0f8b23 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.520356 Jul 21 08:23:01.991477 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:23:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:23:02.003282 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-14eb9adc-5a0c-4116-96b5-a4dde0b77cfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:02.027345 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-14eb9adc-5a0c-4116-96b5-a4dde0b77cfa admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027656 Jul 21 08:23:02.027944 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 21 08:23:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:23:04.345809 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-21c5e019-069f-43b6-bd7c-d7a84e0f8b23 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:04.346822 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-21c5e019-069f-43b6-bd7c-d7a84e0f8b23 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 21 08:23:04.347225 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:04.783137 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-8d3c0b8a-6710-415f-83cc-871488269a4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "vcpus": 4, "id": "4", "ram": 8192, "name": "m1.large"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:04.801767 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-8d3c0b8a-6710-415f-83cc-871488269a4c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448065 Jul 21 08:23:04.802327 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:23:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:23:04.814371 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-edd43829-84f1-492d-aade-0726e3cb3fa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:04.838630 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-edd43829-84f1-492d-aade-0726e3cb3fa9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028182 Jul 21 08:23:04.839191 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 21 08:23:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:23:07.143940 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-8d3c0b8a-6710-415f-83cc-871488269a4c admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:07.145766 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-8d3c0b8a-6710-415f-83cc-871488269a4c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002294 Jul 21 08:23:07.146232 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:07.625236 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-71e78847-7ae6-4df1-aed4-6159ac703da4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "vcpus": 8}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:07.645029 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-71e78847-7ae6-4df1-aed4-6159ac703da4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.492521 Jul 21 08:23:07.645590 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Thu Jul 21 08:23:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:23:07.657929 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-afd3246c-5491-4f9e-a357-923dee0525bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:07.661777 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:07.690852 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-afd3246c-5491-4f9e-a357-923dee0525bd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036580 Jul 21 08:23:07.691770 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Thu Jul 21 08:23:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:23:32.381416 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-71e78847-7ae6-4df1-aed4-6159ac703da4 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:32.382690 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-71e78847-7ae6-4df1-aed4-6159ac703da4 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 21 08:23:32.383089 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:23:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:32.393609 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:32.780564 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-94780ca1-56b5-4edf-8736-60b8c72ce8dc admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:32.797141 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-94780ca1-56b5-4edf-8736-60b8c72ce8dc admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408018 Jul 21 08:23:32.797686 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Thu Jul 21 08:23:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:23:33.865049 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-71e78847-7ae6-4df1-aed4-6159ac703da4 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:33.866059 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-71e78847-7ae6-4df1-aed4-6159ac703da4 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 21 08:23:33.866460 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:34.383101 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-70d6d683-1e88-4de9-9033-7f86ef37edd7 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:34.388872 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-70d6d683-1e88-4de9-9033-7f86ef37edd7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-70d6d683-1e88-4de9-9033-7f86ef37edd7 admin admin] Request method failure captured: Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Host: 10.222.0.47 Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi2Q0F-41pwDM-tnWkM02kEpMeJ__W04n20yqOfRFIb9TlvU5T1dGjQiOWQ3Mu6a-rb3DyS_Iu4srfCpuDM6gq8gtkjPQCmNBX1zT-SkqjfBZCiL3qCKZ1-g0sfm3HPbrbEMbTFioe1gkoMXQaV5db1T0PSIvAEvxLVh40BAsrBoEL7Kw Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Role: member,admin,reader Jul 21 08:23:34.392151 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Roles: member,admin,reader Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User: admin Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Id: 2dce40b8d74c41ec94cc36e6ff05d412 Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: method: > Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: exception: Flavor 42 could not be found. Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: action_args: {'id': '42'} Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:23:34.393873 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:34.395010 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.396983 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-70d6d683-1e88-4de9-9033-7f86ef37edd7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:23:34.398242 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-70d6d683-1e88-4de9-9033-7f86ef37edd7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389987 Jul 21 08:23:34.398242 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Jul 21 08:23:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:34.403667 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-0ed6c43d-45bf-4186-845e-a7b26fc7e414 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:34.406517 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:34.426369 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-0ed6c43d-45bf-4186-845e-a7b26fc7e414 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026202 Jul 21 08:23:34.426936 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 21 08:23:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:23:34.437217 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-c532255b-d5bb-463b-9ef4-b88f32aaac5c admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:34.459043 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-c532255b-d5bb-463b-9ef4-b88f32aaac5c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025332 Jul 21 08:23:34.459642 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 21 08:23:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:23:34.470315 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7f30e5e6-209e-4e8b-9bc2-98225ea53d6f admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:34.477075 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-7f30e5e6-209e-4e8b-9bc2-98225ea53d6f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7f30e5e6-209e-4e8b-9bc2-98225ea53d6f admin admin] Request method failure captured: Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Host: 10.222.0.47 Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi2Q0F-41pwDM-tnWkM02kEpMeJ__W04n20yqOfRFIb9TlvU5T1dGjQiOWQ3Mu6a-rb3DyS_Iu4srfCpuDM6gq8gtkjPQCmNBX1zT-SkqjfBZCiL3qCKZ1-g0sfm3HPbrbEMbTFioe1gkoMXQaV5db1T0PSIvAEvxLVh40BAsrBoEL7Kw Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Role: member,admin,reader Jul 21 08:23:34.480432 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Roles: member,admin,reader Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User: admin Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Id: 2dce40b8d74c41ec94cc36e6ff05d412 Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: method: > Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: exception: Flavor 42 could not be found. Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: action_args: {'id': '42'} Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:23:34.482004 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:34.482868 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:34.483973 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7f30e5e6-209e-4e8b-9bc2-98225ea53d6f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:23:34.485171 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7f30e5e6-209e-4e8b-9bc2-98225ea53d6f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016221 Jul 21 08:23:34.485171 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Jul 21 08:23:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:35.462482 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-c532255b-d5bb-463b-9ef4-b88f32aaac5c admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:35.463530 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-c532255b-d5bb-463b-9ef4-b88f32aaac5c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 21 08:23:35.463934 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:23:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:35.996420 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-f9c179b5-428b-41de-a876-834958a7c560 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:36.002261 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-f9c179b5-428b-41de-a876-834958a7c560 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-f9c179b5-428b-41de-a876-834958a7c560 admin admin] Request method failure captured: Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Host: 10.222.0.47 Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi2Q0HXGEiCxk4RLtSEfAefqE3d1BYNr0TmpMsTCxQRkSc3BiKeOCpWxqSxjQtuiHvRE8M7toxUxktaRPEn93jpnToKgOn9468OO5Num-JqwAHFAHnReECp3gXO8079VMZztuJs9PVZor73ANZuKrrsbINNr1JsNaO6Z3DypegX8nLsUA Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Role: member,admin,reader Jul 21 08:23:36.003813 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Roles: member,admin,reader Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User: admin Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Id: 2dce40b8d74c41ec94cc36e6ff05d412 Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: method: > Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: exception: Flavor 84 could not be found. Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: action_args: {'id': '84'} Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:23:36.005388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:36.006823 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.008466 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-f9c179b5-428b-41de-a876-834958a7c560 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:23:36.009684 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-f9c179b5-428b-41de-a876-834958a7c560 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398752 Jul 21 08:23:36.009684 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Jul 21 08:23:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:36.015750 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-b08be408-4e21-4816-ac3a-886ddf1803c9 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:36.029419 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-b08be408-4e21-4816-ac3a-886ddf1803c9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017278 Jul 21 08:23:36.029949 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 21 08:23:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:23:36.039388 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-c0a4f07e-8222-464c-9906-1e60a2527642 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:36.053287 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-c0a4f07e-8222-464c-9906-1e60a2527642 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017414 Jul 21 08:23:36.053819 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 21 08:23:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:23:36.063582 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-1c157810-102d-4369-af4d-24f27d5da232 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:36.069580 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-1c157810-102d-4369-af4d-24f27d5da232 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-1c157810-102d-4369-af4d-24f27d5da232 admin admin] Request method failure captured: Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Host: 10.222.0.47 Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi2Q0HXGEiCxk4RLtSEfAefqE3d1BYNr0TmpMsTCxQRkSc3BiKeOCpWxqSxjQtuiHvRE8M7toxUxktaRPEn93jpnToKgOn9468OO5Num-JqwAHFAHnReECp3gXO8079VMZztuJs9PVZor73ANZuKrrsbINNr1JsNaO6Z3DypegX8nLsUA Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Role: member,admin,reader Jul 21 08:23:36.071069 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Roles: member,admin,reader Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User: admin Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Id: 2dce40b8d74c41ec94cc36e6ff05d412 Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: method: > Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: exception: Flavor 84 could not be found. Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: action_args: {'id': '84'} Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:23:36.072468 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:36.073238 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:36.074461 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-1c157810-102d-4369-af4d-24f27d5da232 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:23:36.075737 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-1c157810-102d-4369-af4d-24f27d5da232 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012994 Jul 21 08:23:36.075737 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Jul 21 08:23:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:37.046552 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-c0a4f07e-8222-464c-9906-1e60a2527642 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:37.047596 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-c0a4f07e-8222-464c-9906-1e60a2527642 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 21 08:23:37.047993 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:23:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:37.574806 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-9277debd-7a97-4d39-87b2-289d5998156a admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:37.580499 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-9277debd-7a97-4d39-87b2-289d5998156a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-9277debd-7a97-4d39-87b2-289d5998156a admin admin] Request method failure captured: Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Host: 10.222.0.47 Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi2Q0I_pR5CcTa9osYXrgouHT8k-uX6PIFhcA4zuUEWqIZtKzU4jrexRqoTePhn7EdZxXAlirEApeWu8I30ifUCYmiMs4DSW7va870AScU1oC0zp9yVKEMOukPo8kwND0XgoJy4sjTprSqS_SyPgoIy-srjr0v06ohe6goVyiipL0vulY Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Role: member,admin,reader Jul 21 08:23:37.581981 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Roles: member,admin,reader Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User: admin Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Id: 2dce40b8d74c41ec94cc36e6ff05d412 Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: method: > Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: exception: Flavor 451 could not be found. Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: action_args: {'id': '451'} Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:23:37.583649 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:37.584660 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.585988 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-9277debd-7a97-4d39-87b2-289d5998156a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:23:37.587307 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-9277debd-7a97-4d39-87b2-289d5998156a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397650 Jul 21 08:23:37.587307 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 21 08:23:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:37.595000 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-53139e61-1113-4cc8-bb6a-e2963fbdd893 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:37.610363 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-53139e61-1113-4cc8-bb6a-e2963fbdd893 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018940 Jul 21 08:23:37.610924 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 21 08:23:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:23:37.621131 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:37.636848 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019332 Jul 21 08:23:37.637385 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Jul 21 08:23:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:23:37.646663 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-c5ddc431-f7f5-46c8-a52d-465e5da2d583 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:37.652138 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-c5ddc431-f7f5-46c8-a52d-465e5da2d583 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-c5ddc431-f7f5-46c8-a52d-465e5da2d583 admin admin] Request method failure captured: Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Host: 10.222.0.47 Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi2Q0I_pR5CcTa9osYXrgouHT8k-uX6PIFhcA4zuUEWqIZtKzU4jrexRqoTePhn7EdZxXAlirEApeWu8I30ifUCYmiMs4DSW7va870AScU1oC0zp9yVKEMOukPo8kwND0XgoJy4sjTprSqS_SyPgoIy-srjr0v06ohe6goVyiipL0vulY Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Role: member,admin,reader Jul 21 08:23:37.653643 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Roles: member,admin,reader Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42d15fc0515945acacbbffcf2356c7a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 42d15fc0515945acacbbffcf2356c7a5 Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User: admin Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Id: 2dce40b8d74c41ec94cc36e6ff05d412 Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: method: > Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: exception: Flavor 451 could not be found. Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: action_args: {'id': '451'} Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:23:37.655196 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:37.656192 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 21 08:23:37.657351 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-c5ddc431-f7f5-46c8-a52d-465e5da2d583 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:23:37.658371 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-c5ddc431-f7f5-46c8-a52d-465e5da2d583 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011940 Jul 21 08:23:37.658371 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 21 08:23:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 08:23:38.639727 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:38.640735 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 21 08:23:38.641128 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:39.206329 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-76bddf03-3d6d-4204-bf5b-fdabbb490f17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:39.225106 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-76bddf03-3d6d-4204-bf5b-fdabbb490f17 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.445492 Jul 21 08:23:39.225651 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Jul 21 08:23:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:23:40.209032 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:40.210032 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 21 08:23:40.210424 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:40.743025 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-2c80766f-a67e-45a4-bcb8-b99f18e7d0fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:40.760319 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-2c80766f-a67e-45a4-bcb8-b99f18e7d0fd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.407202 Jul 21 08:23:40.760855 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Jul 21 08:23:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:23:41.729664 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:41.730678 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 21 08:23:41.731079 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:42.253555 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-294a8a47-3372-4b6e-9d30-836cfadd2259 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:42.271247 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-294a8a47-3372-4b6e-9d30-836cfadd2259 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.399113 Jul 21 08:23:42.271831 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Jul 21 08:23:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 08:23:43.254150 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:43.255167 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 21 08:23:43.255623 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:43.786182 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e0c80e4b-905a-4931-b620-53688c1bfe69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:23:43.803561 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e0c80e4b-905a-4931-b620-53688c1bfe69 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407571 Jul 21 08:23:43.804098 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Jul 21 08:23:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:23:44.778826 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:44.779867 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 21 08:23:44.780277 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:23:45.337744 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-971940eb-904b-4bc0-a1f1-05278ba98da0 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:23:45.356908 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-971940eb-904b-4bc0-a1f1-05278ba98da0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.440072 Jul 21 08:23:45.357385 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Thu Jul 21 08:23:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:24:37.607667 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:24:37.608680 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bf45bed1-ecfe-4a1c-8f2c-ff2a30c0da01 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 21 08:24:37.609090 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Thu Jul 21 08:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:24:37.619688 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:38.012576 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-32b921bb-46df-40fb-85a5-5a2027e89b19 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:24:38.031837 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-32b921bb-46df-40fb-85a5-5a2027e89b19 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416391 Jul 21 08:24:38.032304 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Thu Jul 21 08:24:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:24:38.054452 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=14 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:24:38.058602 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-5924fae1-3d1c-4f03-b2af-4b53cced83a1 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:24:38.066305 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-5924fae1-3d1c-4f03-b2af-4b53cced83a1 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013330 Jul 21 08:24:38.066862 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Thu Jul 21 08:24:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:24:38.078464 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-44be579f-87fd-415c-a21f-47b213ebe87d admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:24:38.086059 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-44be579f-87fd-415c-a21f-47b213ebe87d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011153 Jul 21 08:24:38.086576 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Thu Jul 21 08:24:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:24:38.098087 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:24:38.105494 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011455 Jul 21 08:24:38.106016 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Thu Jul 21 08:24:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:24:38.118002 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-92341b92-d9b1-4223-a9d0-c84506487783 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:24:38.125839 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-92341b92-d9b1-4223-a9d0-c84506487783 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011383 Jul 21 08:24:38.126359 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Thu Jul 21 08:24:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:28:07.309743 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:28:07.310798 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 21 08:28:07.311187 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:28:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:28:07.456263 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=6 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:07.623345 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-1abfb20b-5b90-48b4-8d17-fe0081bd19c8 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:28:07.624919 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:28:07.624919 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 21 08:28:07.626113 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-1abfb20b-5b90-48b4-8d17-fe0081bd19c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:28:07.626554 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-1abfb20b-5b90-48b4-8d17-fe0081bd19c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:28:07.627875 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-1abfb20b-5b90-48b4-8d17-fe0081bd19c8 admin admin] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:28:07.628311 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-1abfb20b-5b90-48b4-8d17-fe0081bd19c8 admin admin] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:28:07.662737 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-1abfb20b-5b90-48b4-8d17-fe0081bd19c8 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208396 Jul 21 08:28:07.663305 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 21 08:28:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:28:08.500770 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:28:08.501923 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jul 21 08:28:08.502324 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:28:08.727684 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7cd9affb-2764-412e-bcb5-3b3663423df9 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:28:08.728964 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:28:08.728964 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 21 08:28:08.730316 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-7cd9affb-2764-412e-bcb5-3b3663423df9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:28:08.730763 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-7cd9affb-2764-412e-bcb5-3b3663423df9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:28:08.731695 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-7cd9affb-2764-412e-bcb5-3b3663423df9 admin admin] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:28:08.732129 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-7cd9affb-2764-412e-bcb5-3b3663423df9 admin admin] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:28:08.753281 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7cd9affb-2764-412e-bcb5-3b3663423df9 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083250 Jul 21 08:28:08.753893 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 21 08:28:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:28:20.017860 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:28:20.018878 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Jul 21 08:28:20.019310 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:28:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:28:20.162055 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell0:SELECT=4 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:20.162759 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell1:SELECT=4 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:20.163429 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=8 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:20.212348 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e7158117-e108-4467-b272-e7a418505320 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:28:20.213515 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:28:20.213515 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 21 08:28:20.214741 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-e7158117-e108-4467-b272-e7a418505320 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:28:20.215184 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-e7158117-e108-4467-b272-e7a418505320 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:28:20.216001 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-e7158117-e108-4467-b272-e7a418505320 admin admin] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:28:20.216436 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-e7158117-e108-4467-b272-e7a418505320 admin admin] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:28:20.241240 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e7158117-e108-4467-b272-e7a418505320 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083499 Jul 21 08:28:20.241741 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 21 08:28:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:28:21.067408 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:28:21.068410 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ee642220-0f0e-46de-a021-4627a15764dc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 21 08:28:21.068808 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Jul 21 08:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:28:21.259438 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7f586746-6c90-410a-b79a-0d3e1e7463d0 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:28:21.260616 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:28:21.260616 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 21 08:28:21.261837 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-7f586746-6c90-410a-b79a-0d3e1e7463d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:28:21.262285 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-7f586746-6c90-410a-b79a-0d3e1e7463d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:28:21.263059 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-7f586746-6c90-410a-b79a-0d3e1e7463d0 admin admin] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:28:21.263520 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-7f586746-6c90-410a-b79a-0d3e1e7463d0 admin admin] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:28:21.286114 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7f586746-6c90-410a-b79a-0d3e1e7463d0 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079551 Jul 21 08:28:21.286665 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Jul 21 08:28:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:29:18.885760 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: Thu Jul 21 08:29:18 2022 - graceful shutdown triggered... Jul 21 08:29:18.885890 dv-cinder-850320-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 08:29:18.886898 dv-cinder-850320-1-iscsi devstack@n-api.service[103225]: Gracefully killing worker 2 (pid: 103225)... Jul 21 08:29:18.887285 dv-cinder-850320-1-iscsi devstack@n-api.service[103224]: Gracefully killing worker 1 (pid: 103224)... Jul 21 08:29:19.888097 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: worker 1 buried after 1 seconds Jul 21 08:29:19.888097 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: worker 2 buried after 1 seconds Jul 21 08:29:19.888097 dv-cinder-850320-1-iscsi devstack@n-api.service[103223]: goodbye to uWSGI. Jul 21 08:29:19.889615 dv-cinder-850320-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 08:29:19.890185 dv-cinder-850320-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 08:29:19.893087 dv-cinder-850320-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 08:29:19.902100 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 08:29:19 2022] *** Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: nodename: dv-cinder-850320-1-iscsi Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: machine: x86_64 Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: clock source: unix Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: pcre jit disabled Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: detected number of CPU cores: 4 Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: current working directory: / Jul 21 08:29:19.904288 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: detected binary path: /usr/bin/uwsgi-core Jul 21 08:29:19.904954 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: your processes number limit is 47680 Jul 21 08:29:19.904954 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: your memory page size is 4096 bytes Jul 21 08:29:19.904954 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: detected max file descriptor number: 2048 Jul 21 08:29:19.904954 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: lock engine: pthread robust mutexes Jul 21 08:29:19.904954 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: thunder lock: enabled Jul 21 08:29:19.904954 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 08:29:19.904954 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 08:29:19.949009 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: Python main interpreter initialized at 0x560d7029b9c0 Jul 21 08:29:19.949009 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: python threads support enabled Jul 21 08:29:19.949009 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: your server socket listen backlog is limited to 100 connections Jul 21 08:29:19.949009 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: your mercy for graceful operations on workers is 90 seconds Jul 21 08:29:19.949435 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 08:29:19.949435 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: *** Operational MODE: preforking *** Jul 21 08:29:19.949728 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: *** uWSGI is running in multiple interpreter mode *** Jul 21 08:29:19.949892 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: spawned uWSGI master process (pid: 117934) Jul 21 08:29:19.950225 dv-cinder-850320-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 08:29:19.952442 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: spawned uWSGI worker 1 (pid: 117950, cores: 1) Jul 21 08:29:19.952442 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: spawned uWSGI worker 2 (pid: 117951, cores: 1) Jul 21 08:29:19.952442 dv-cinder-850320-1-iscsi devstack@n-api.service[117934]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 08:29:20.613775 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 08:29:20.661605 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 08:29:21.815160 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:29:21.815160 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: from cryptography.utils import int_from_bytes Jul 21 08:29:21.815839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:29:21.815839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: from cryptography.utils import int_from_bytes Jul 21 08:29:21.854538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:29:21.854538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: from cryptography.utils import int_from_bytes Jul 21 08:29:21.855122 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:29:21.855122 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: from cryptography.utils import int_from_bytes Jul 21 08:29:24.151353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:29:24.151353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:29:24.151999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:29:24.151999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:29:24.152165 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:29:24.159364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.159364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.159364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.159364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.159364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.159364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.159364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.159364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-1-iscsi {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160533 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160533 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160533 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.160533 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167907 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.167979 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.171361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.171361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-1-iscsi {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.171361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.171361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.171361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.171361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.171361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.171361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.172082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.173200 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.173611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.174027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.174554 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.175108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.175531 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.175913 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.176312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.176700 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.177540 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.177931 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.178375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.178847 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.179240 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.179698 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.180101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.180507 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.180832 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.181167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.182906 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.183497 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.184072 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.184473 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.184979 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.185530 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.186908 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.188004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.188410 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.189544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.189977 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.190389 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.190806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.191419 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.192001 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.193056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.193691 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.194090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.194524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.195091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.195688 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.196330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.196918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.197319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.198193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.198596 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.199005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.199590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.200100 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.200428 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.200839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.201488 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.202177 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.202856 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.203928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.205020 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.205420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.205961 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.206352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.206747 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.207137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.207552 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.208409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.208803 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.209289 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.210226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.210975 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.211626 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.212022 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.212450 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.212844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.213354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.213894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.214283 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.214674 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.215210 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.215660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.216194 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.216609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.217001 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.217387 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.217899 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.218667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.219056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.219479 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.220020 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.220936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.221326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.221713 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.222097 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.222645 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.223044 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.223546 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.224040 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.224441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.224845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.225352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.225740 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.227021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.227467 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.227896 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.228784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.229214 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.229826 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.230312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.230730 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.231132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.231553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.231951 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.232358 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.232866 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.233261 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.233776 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.234296 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.234692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.235103 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.235673 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.236073 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.236472 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.237003 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.237424 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.237871 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.238491 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.239112 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.239560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.239983 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.240380 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.240785 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.241203 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.241595 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.241985 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.242378 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.242780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.243292 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.243826 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.244340 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.244735 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.245128 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.245628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.246025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.246418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.246902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.247475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.247874 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.248384 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.249102 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.249848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.249997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.250454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.250871 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.251338 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.251759 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.252184 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.252700 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.253263 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.253837 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.254390 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.255092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.255537 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.256073 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.256496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.256921 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.257493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.257919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.258462 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.259288 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.259764 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.260190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.260609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.261041 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.261460 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.261874 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.262304 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.262725 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.263280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.264064 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.264647 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.265089 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.265692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.266255 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.267566 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.268021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.268449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.269375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.269819 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.270150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.270473 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.270862 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.271167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.271521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.271834 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.272155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.272492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.272819 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.273127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.273570 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.273890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.274256 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.274596 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.274919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.275234 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.275651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.276133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.276450 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.276805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.277140 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.277476 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.277954 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.278288 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.278796 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.279384 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.279813 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.280149 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.280475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.280808 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.281131 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.281464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.281779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.282112 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.282431 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.283679 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.284005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.284335 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.284708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.285024 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.285353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.285684 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.286004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.286454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.286768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.287091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.287506 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.287783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.288113 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.288433 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.289091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.290495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.290495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.290495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.290863 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.290863 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.297749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.297749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.297749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.297749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.297749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.297749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.297749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.297749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.298312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.298312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.298312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.298312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.298312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.298312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.298312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.298312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299948 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.299948 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.300083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.300405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.300741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.301098 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.301367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.301686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.302045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.302464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.302663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.302992 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.303365 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.303711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.303994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.304322 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.304643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.304984 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.305319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.305634 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.305955 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.306272 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.306706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.307033 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.307448 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.307773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.308091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.308409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.308723 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.309075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.309430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.310004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.310475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.310804 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.311131 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.311481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.311813 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.312153 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.312493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.312842 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.313158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.313477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.314356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.314671 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.314990 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.315308 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.315657 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.315968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.316283 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.316622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.316934 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.317248 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.317762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.317873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.318173 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.318491 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.318800 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.319128 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.319481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.319789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.320098 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.320547 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.320905 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.321219 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.321567 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.321905 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.322255 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.322567 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.322884 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.323216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.323568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.323880 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.324191 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.324530 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.324847 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.325155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.325473 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.325787 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.326104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.326418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.326726 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.327041 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.327484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.328530 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.328530 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.328530 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.328783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.329050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.329457 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.330327 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.330629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.330941 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.331264 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.331616 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.334075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.334445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.334797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.335270 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.335632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.336064 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.336319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.336649 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.336974 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.337303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.337626 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.338067 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.338274 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.338614 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.338949 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.339266 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.339740 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.340066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.340386 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.340706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.341053 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.341368 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.341682 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.341998 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.342314 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.342628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.342961 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.343281 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.343666 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.343984 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.344297 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.344647 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.344988 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.345372 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.345696 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.346014 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.346342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.346665 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.347002 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.347303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.347754 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.347964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.348445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.348611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.348909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.349221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.349548 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.349871 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.350203 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.350510 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:29:24.350936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.351022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:29:24.351107 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.351257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.351445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:29:24.351525 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.351914 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:29:24.352175 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.352340 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:29:24.352503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.352503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.352916 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.353116 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.353282 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.353282 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.353578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.353730 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.353905 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.354076 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.354224 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.354379 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.354523 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.354687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.354880 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.355027 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.355180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.355180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.355511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.355511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.355784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.355942 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.356099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.356251 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-1-iscsi {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.356401 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.356546 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.356688 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.356838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.356999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.357204 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.357361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.357506 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.357667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.357894 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.358063 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.358207 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.358434 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.358672 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.358830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.358830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.359114 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.359315 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.359487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.359633 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.359788 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.359942 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.360085 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.360235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.360386 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.360529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.360730 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.360890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.361052 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.361204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.361361 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.361512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.361672 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.361672 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.362128 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.362375 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.362528 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.362528 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.362812 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-1-iscsi {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.362964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.363114 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.363269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.363536 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.363697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.363842 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.363996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.364149 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.364293 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.364444 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.364600 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.364752 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.364906 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.365058 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.365202 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.365365 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.365509 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.365659 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.365812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.365956 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.366106 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.366258 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.366402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.366545 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.366702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.367023 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.367181 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.367466 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.367466 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.367628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.367721 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.367805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.368024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.368112 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.368194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.368268 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.368268 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.368485 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.368766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.368870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.369068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.369177 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.369384 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.369486 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.369720 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.369833 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.370079 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.370180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.370376 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.370485 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.370648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.370744 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.370906 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.371021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.371212 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.371405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.371571 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.371739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.371896 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.372003 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.372224 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.372335 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.372708 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.372812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.372897 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.373072 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.373243 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.373399 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.373622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.373785 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.374022 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.374128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.374336 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.374440 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.374648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.374738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.374979 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.375089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.375359 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.375454 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.375693 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.375829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.376043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.376940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.377108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.377256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.377256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.377546 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.377699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.377860 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.378019 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.378258 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.378258 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.378623 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.378779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.378935 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.379393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.380473 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.380577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.380675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.380675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.380843 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.381928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.382027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.382124 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.382219 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.382313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.382410 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.382504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.382592 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.382671 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.382762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.382854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.383017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.383105 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.383198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.383290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.385093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.385219 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.385536 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.385628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.385722 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.385811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.385897 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.385992 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.386079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.386172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.386258 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.386342 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.386426 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.386519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.386604 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.386695 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.386781 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.387844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.387844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.388031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.388127 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.388221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.388842 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.388957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.389064 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.389150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.389242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.389330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.389422 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.389508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.389508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.389667 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.389739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.389829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.389914 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.391468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.391579 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.392850 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.392967 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.393299 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.393401 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.393489 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.393583 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.393670 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.393762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.393858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.393952 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.394047 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.394133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.394218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.394317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.394404 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.394489 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.394574 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.394667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.394754 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.394848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.394943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.395037 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.395123 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.395216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.395303 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.395514 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.395659 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.395791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.395921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.396050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.396179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.396318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.396450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.396587 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.396716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.396845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.396988 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.396988 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.397241 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.397241 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.397495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.397632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.397770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.397915 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.398046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.398183 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.398312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.398541 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.398689 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.398901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.399034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.399163 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.399292 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.399451 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.399597 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.399736 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.399864 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.399993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.400130 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:29:24.400269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.400389 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.400518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.400655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.400800 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.400939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.401082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.401221 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.401350 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.401529 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.401672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.401672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.401949 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.402081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.402217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.402347 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.402482 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.402622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.402751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.402879 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.402997 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.403125 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.403253 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.403425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.403565 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.403706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.403844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.403981 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.404118 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.404261 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.404391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.404528 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.404528 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.404782 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.404920 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.405058 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.405195 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.405333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.405466 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.405606 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.405749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.405887 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.406024 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.406154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.406291 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.406428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.406571 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.406701 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.406839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.406968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.407105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.407279 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.407428 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.407582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.407711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.407842 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.407983 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.408127 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.408257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.408393 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.408538 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.408746 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.408903 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.409110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.409252 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.409383 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.409521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.409647 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.409783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.409783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.410046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.410183 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.410308 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.410436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.410562 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.410691 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.410819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.410819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.411071 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.411200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.411495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.411631 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.411773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.411904 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.412042 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.412172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.412445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.412590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.412729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.412858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.412994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.413125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.413935 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.414117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.414266 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.414266 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.414266 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.414711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.414842 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.414972 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.415297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.415661 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.416006 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.416326 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.416848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.417213 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.418418 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.418587 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.418742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.418962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.419110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.419310 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.419310 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.419641 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.419641 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.419884 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420144 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420273 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420546 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420676 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420805 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420933 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.420933 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.421184 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.421329 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.421468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.421598 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.421735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.421864 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.421992 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.422129 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.422387 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.422521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.422762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.422901 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.423102 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.423251 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.424257 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.425448 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.425607 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.425753 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.425753 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.426077 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.426210 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.426340 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.426479 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.426610 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.426757 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.426887 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.427016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.427156 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.427294 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.427468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.427613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.427744 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.427874 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.428012 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.428142 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.428284 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.428415 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.428415 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.428682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.428822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.428967 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.429178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.429327 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.429524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.429658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.429796 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.429918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.430056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.430187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.430315 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.430452 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.430572 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.430707 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.430845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.430983 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.431113 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.431242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.431385 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.431527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.431673 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.431803 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.431940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.432078 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.432215 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.432358 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.432488 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.432626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.432763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.432900 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.433031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.433174 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.433303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.433432 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.433575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.433704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.433830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.433955 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.434086 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.434214 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.434343 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.434473 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.434609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.434747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.434885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.435022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.435153 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.435282 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.435522 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.435661 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.435798 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.435927 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.436063 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.436194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.436331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.436461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.436598 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.436735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.436864 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.437042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.437198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.437369 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.437511 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.437708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.437840 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.438025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.438173 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.438342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.438477 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.438658 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.439403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.439566 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.439770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.439919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.440039 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.440167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.440297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.440437 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.440568 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.440740 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.440883 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.441056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.441226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.441367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.441547 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.441711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.441903 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.442043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.442255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.442389 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.442601 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.442736 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.442930 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.443083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.443262 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.443643 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.443784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.443916 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.444034 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.445610 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.445786 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.445923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446054 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446183 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446183 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446437 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446585 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446585 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446585 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.446962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.447362 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.447506 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.447720 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.448040 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.448344 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.448761 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.449261 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.449514 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.449678 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.449928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.450081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.450235 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.450388 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.450533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.450687 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.450849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.450995 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.451140 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.451304 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.451535 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.451688 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.451887 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.452041 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.452226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.452375 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.452544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.452696 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.452849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.453003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.453265 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.453452 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.453622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.453784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.453938 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.454084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.454243 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.454451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.455098 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.455259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.455432 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.455578 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.455734 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.455918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.456081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.456263 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.456413 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.456580 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.456746 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.456900 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.457051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.457205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.457349 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.457501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.457726 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.457877 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.458072 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.458242 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.458396 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.458539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.458697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.458852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.459011 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.459155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.459308 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.459510 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.459738 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.459906 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.460133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.460284 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.460438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.460583 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.460735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.460887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.461046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.461190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.461336 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.461493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.461638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.461907 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.462060 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.462215 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.462362 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.462529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.462682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.462836 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.462989 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.463141 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.463286 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.463471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.463617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.463777 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.463923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.464066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.464219 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.464371 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.464531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.464684 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.464829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.464974 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.465118 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.465270 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.465424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.465577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.465723 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.465874 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.466020 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.466163 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.466325 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.466471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.466617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.466794 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.466947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.467099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.467258 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.467564 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.467721 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.467867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.468019 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.468178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.468323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.468477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.468634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.468786 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.468931 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.469088 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.469242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.469387 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.469644 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.470251 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.470426 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.470590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.470941 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.471428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.475739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.475739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.475739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.475739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.475739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.475739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.476678 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.476678 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.476678 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.477124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.477268 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.477530 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.477714 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.477870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.478031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.478217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.478371 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.478606 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.478758 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.478989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.479153 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.479306 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.479795 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.480062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.481494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.486939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.486939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.486939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.486939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.486939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.486939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.486939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.486939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.488415 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.488591 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.488743 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:29:24.488907 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.489210 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.490162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.490733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.491582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.492144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.492673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.493250 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.493968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.494589 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.495130 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.495690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.496289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.496838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.497407 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.497972 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.498547 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.499084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.499636 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.500553 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.501918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.502473 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.503000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.503575 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.504237 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.505021 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.505586 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.506117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.506661 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.507189 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.507768 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.508295 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.508850 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.509385 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.509975 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.510756 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.511291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.512153 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.512723 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.513245 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.513780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.514428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.514966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.515529 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.516068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.516596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.517688 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.518215 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.518737 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.519303 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.520102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.520908 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.521449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.522150 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.522823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.523398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.523935 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.524612 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.525166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.525693 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.526223 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.526767 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.527297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.527847 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.528392 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.528912 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.529445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.529979 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.530501 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.531286 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.531899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.532779 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.533319 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.533848 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.534529 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.535114 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.535671 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.536367 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.536926 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.537458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.537994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.538537 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.539065 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.539635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.540177 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.540713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.541518 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.542064 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.542724 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.543428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.544032 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.544715 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.545251 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.545793 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.546347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.546901 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.547480 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.548012 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.548632 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.549160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.549690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.550303 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.550866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.551741 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.552331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.553498 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.554363 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.555308 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.556127 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.556917 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.557682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.558494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.559296 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.560173 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.560924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.562031 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.562976 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.564515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.565665 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.566478 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.567259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.568063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.568828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.569592 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.570390 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.571163 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.572267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.573398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.574465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.575476 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.576268 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.577023 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.577704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.578216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.578742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.579441 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.580496 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.581051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.581636 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.582574 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.583226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.584046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.584610 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.585256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.586006 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.586412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.586745 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.587116 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.587495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.587842 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.588164 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.588498 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.588818 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.589155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.589492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.589819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.590145 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.590461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.590798 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.591129 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.592061 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.592061 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.592528 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.592868 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.593190 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.593522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.593857 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.594234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.594484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.594804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.595171 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.595527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.595845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.596162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.596463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.596784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.597099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.597412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.597721 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.598052 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.598361 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.598693 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.599014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.599418 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.599997 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.600516 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.600921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.601428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.601947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.602429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.602743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.603102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.603536 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.603805 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.604103 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.604447 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.604765 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.605110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.605455 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.605889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.606460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.606460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.606945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.607192 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.607662 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.607662 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.608062 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.608247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.608856 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.609373 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.609691 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.610014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.610349 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.610696 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.611031 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.611499 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.611821 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.612138 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.612626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.612991 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.613301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.613731 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.613997 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.614290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.614748 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.615005 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.615263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.615621 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.616043 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.616243 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.616671 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.616867 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.617191 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.617510 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.617828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.618278 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.618603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.618927 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.619533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.619871 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.620193 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.620513 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.620831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.621150 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.621471 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.621793 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.622110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.622479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.622761 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.623093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.623460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.623841 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.624142 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.624473 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.624951 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.625505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.626075 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.627166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.627734 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.628356 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.628874 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.629385 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.630158 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.630659 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.631161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.631763 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.632266 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.632789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.633251 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.633754 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.634257 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.634774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.635309 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.635852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.636347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.636913 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.637348 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.638216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.638723 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.639255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.639809 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.640328 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.640835 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.641339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.641918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.642896 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.643397 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.643944 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.644394 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.644885 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.645396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.645891 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.646371 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.646878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.647395 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.648248 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.648796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.649300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.649819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.650342 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.650844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.651354 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.651918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.652357 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.652860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.653341 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.653866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.654461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.654952 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.655492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.655998 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.656504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.656968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.657479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.657912 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Registered counter for database nova_api Jul 21 08:29:24.658078 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.658477 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.658970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.659486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.659984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.660462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.660952 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.661287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.662195 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.662195 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.662195 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.662655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.662829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.663132 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.663453 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.663893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.664203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.664620 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.664943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.665254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.665583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.665898 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.666227 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.666706 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.667155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.667734 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.668227 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.669118 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.669648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.670151 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.670678 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.671196 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.671704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.672191 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.672667 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.674852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.674852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.674852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.675732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.675732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.675732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.676354 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.676922 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.676922 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.677544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.677544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.678097 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.678097 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.678424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.678674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.679036 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.679404 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.679628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:29:24.679769 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.680026 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.680474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.680976 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.681445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.681929 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.682411 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.682908 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.683451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.683970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.684416 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.685080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.685576 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.686081 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.686366 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:29:24.686585 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.687106 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.687667 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.688163 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.688490 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.689456 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.689785 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.690129 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.690499 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.690871 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.691207 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.691548 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.691864 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.692181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.692523 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.693025 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.693507 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.693982 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.694455 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.694938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.695451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.695945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.696405 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.696877 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.697358 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.697824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.698305 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.698779 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.699291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.699909 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.700322 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.700647 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.700961 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.701277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.701590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.701928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.702258 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.702603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.702947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.703269 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.703681 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.704104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.704637 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.705404 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.705921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.706428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.706931 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.708299 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.708299 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.708649 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.708924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.709525 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.710016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.710530 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.711062 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.711635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.712129 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.712596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.713031 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.713367 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.713702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.714030 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.714350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.714692 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.715017 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.715361 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.715712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.716034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.716353 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.716679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.716995 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.717316 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.717638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.717960 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.718295 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.718631 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.718947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.719281 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.719638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.720028 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.720355 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.720708 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.721044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.721391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.721712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.722024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:29:24.722274 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:29:24.743765 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.context [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ace4bd78-5500-4e99-9aa8-321e61ee020f(cell1) {{(pid=117951) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 08:29:24.748183 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:29:24.749767 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:29:24.750568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:29:24.753196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:29:24.755458 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Registered counter for database nova_cell0 Jul 21 08:29:24.759491 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Registered counter for database nova_cell1 Jul 21 08:29:24.768725 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:29:24.769502 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:29:24.776843 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:29:24.778156 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:29:24.877963 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO dbcounter [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Registered counter for database nova_api Jul 21 08:29:24.898678 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_db.sqlalchemy.engines [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:29:24.906082 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writer thread running {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:29:24.928946 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Registered counter for database nova_cell0 Jul 21 08:29:24.935612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:29:24.940438 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:29:24.962936 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.context [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ace4bd78-5500-4e99-9aa8-321e61ee020f(cell1) {{(pid=117950) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 08:29:24.966952 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:29:24.968575 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:29:24.969386 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:29:24.971529 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:29:24.973586 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO dbcounter [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Registered counter for database nova_cell0 Jul 21 08:29:24.981475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO dbcounter [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Registered counter for database nova_cell1 Jul 21 08:29:24.991472 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_db.sqlalchemy.engines [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:29:24.992954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_db.sqlalchemy.engines [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:29:24.999921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writer thread running {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:29:25.002710 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writer thread running {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:29:25.171566 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO dbcounter [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Registered counter for database nova_cell0 Jul 21 08:29:25.180234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_db.sqlalchemy.engines [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:29:25.185851 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writer thread running {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:29:25.261240 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 08:29:25.268567 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 08:29:25.553318 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: WARNING keystonemiddleware.auth_token [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 08:29:25.561888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: WARNING keystonemiddleware.auth_token [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 08:29:25.612409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 08:29:25.618395 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-9a878771-c65e-4ad1-abc6-877795e3e923 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 08:29:25.624632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560d7029b9c0 pid: 117951 (default app) Jul 21 08:29:25.949466 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: WARNING keystonemiddleware.auth_token [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 08:29:25.956206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: WARNING keystonemiddleware.auth_token [None req-4c90c384-ad32-450e-86c4-6faae7612725 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 08:29:25.961509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560d7029b9c0 pid: 117950 (default app) Jul 21 08:30:07.810903 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:07.811931 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:07.812697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:07.813482 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:09.604250 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3aa7fe58-6f8d-4bc3-8d57-15ed7d2c8d92 tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] Action: 'create', calling method: .version_select at 0x7f65be4bdca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-754023773", "metadata": {"Type": "work"}}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:13.217278 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3aa7fe58-6f8d-4bc3-8d57-15ed7d2c8d92 tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 5.415603 Jul 21 08:30:13.219187 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Jul 21 08:30:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 5420 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 08:30:13.793053 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f5cfafba-e620-4a67-a4b9-5d1eba32ce90 tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] Calling method '.version_select at 0x7f65be538790>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:13.848669 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:13.849785 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:13.851104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:13.853533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:14.918082 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f5cfafba-e620-4a67-a4b9-5d1eba32ce90 tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee" status: 200 len: 353 microversion: 2.1 time: 1.689412 Jul 21 08:30:14.918962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1/2] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:30:13 2022] GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee => generated 353 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:30:14.932734 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-61b75003-7232-41b3-b2a3-9547b8f07a47 tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] Calling method '.version_select at 0x7f65be318af0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:15.026825 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-61b75003-7232-41b3-b2a3-9547b8f07a47 tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee" status: 200 len: 353 microversion: 2.1 time: 0.100117 Jul 21 08:30:15.027584 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:30:14 2022] GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:30:15.049283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-631657c0-7b94-4f69-a527-83e121fe63cb tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] Calling method '.version_select at 0x7f65be30daf0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:15.317238 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-631657c0-7b94-4f69-a527-83e121fe63cb tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee" status: 202 len: 0 microversion: 2.1 time: 0.273859 Jul 21 08:30:15.317938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:30:15 2022] DELETE /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:30:15.339785 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0cbb6ce4-bd8b-48da-9449-4d692280c70f tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] Calling method '.version_select at 0x7f65be318c10>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:15.462346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0cbb6ce4-bd8b-48da-9449-4d692280c70f tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee" status: 200 len: 352 microversion: 2.1 time: 0.139039 Jul 21 08:30:15.463045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:30:15 2022] GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:30:16.483172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-29879c27-8046-4bd3-9f98-a1d195ed7f0e tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] Calling method '.version_select at 0x7f65be30dd30>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:16.539933 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-29879c27-8046-4bd3-9f98-a1d195ed7f0e tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] HTTP exception thrown: Volume 6c92a084-87dd-4b69-a964-b588bdf2beee could not be found. Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-29879c27-8046-4bd3-9f98-a1d195ed7f0e tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] Request method failure captured: Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee HTTP/1.1 Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q6PaMn-Yb7_HUg2xlsdM2E9X7xLUcA7QntmY0ueuNjZlMcNPjG1tKuo3QRwGfR8lydU7bkOp5yaCY2KBiBooolhoI_jX2Dr8vmAAuMDGRLEiPTITr3_3c9LUMdk_m76QZaAA_lhlwMw1-gnHzVtMz7lzdxyV9Ov8LzCZwd1XBlBMqg Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: a9d8ff00b3ae4c18971814d983d93e05 Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesGetTestJSON-491253569 Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:30:16.551534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a9d8ff00b3ae4c18971814d983d93e05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a9d8ff00b3ae4c18971814d983d93e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a9d8ff00b3ae4c18971814d983d93e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a9d8ff00b3ae4c18971814d983d93e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesGetTestJSON-491253569 Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: a9d8ff00b3ae4c18971814d983d93e05 Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesGetTestJSON-491253569 Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesGetTestJSON-491253569-project Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 976a5d6aedea4670827416763642c61d Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesGetTestJSON-491253569-project Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Volume 6c92a084-87dd-4b69-a964-b588bdf2beee could not be found. Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '6c92a084-87dd-4b69-a964-b588bdf2beee'} Jul 21 08:30:16.552994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c92a084-87dd-4b69-a964-b588bdf2beee could not be found. (HTTP 404) (Request-ID: req-2b4c846f-ee15-4dee-ab0c-bef1de4a0f56) Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:30:16.553832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:30:16.555000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c92a084-87dd-4b69-a964-b588bdf2beee could not be found. Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 08:30:16.556120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c92a084-87dd-4b69-a964-b588bdf2beee could not be found. Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c92a084-87dd-4b69-a964-b588bdf2beee could not be found. Jul 21 08:30:16.557334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:30:16.559889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-29879c27-8046-4bd3-9f98-a1d195ed7f0e tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] Returning 404 to user: Volume 6c92a084-87dd-4b69-a964-b588bdf2beee could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:30:16.563178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-29879c27-8046-4bd3-9f98-a1d195ed7f0e tempest-VolumesGetTestJSON-491253569 tempest-VolumesGetTestJSON-491253569-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee" status: 404 len: 109 microversion: 2.1 time: 0.090018 Jul 21 08:30:16.564954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:30:16 2022] GET /compute/v2.1/os-volumes/6c92a084-87dd-4b69-a964-b588bdf2beee => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:30:18.417978 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-61563c81-706c-40df-9e43-03a388633d4c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'create', calling method: .version_select at 0x7f65be3311f0>, body: {"keypair": {"name": "tempest-keypair-1814532123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHpLy8tUJwpPbwvvSE38ADldMhrnmyj7NkTBO53xk4UlwhfILp10MK4pcc69y0Llc87Y/W1uRfd8nLlLqRuypCjDFBA8XGDtIcPxOE8rGYe8Y3urwqXuTka8sR0WZeCKg=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:18.600493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-61563c81-706c-40df-9e43-03a388633d4c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Getting quotas for project 1bae82711d354d908d096edaae82c2c5. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:30:18.637149 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-61563c81-706c-40df-9e43-03a388633d4c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Getting quotas for user ad56309db7044cb2a86651d4149cd090 and project 1bae82711d354d908d096edaae82c2c5. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:30:18.762754 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-61563c81-706c-40df-9e43-03a388633d4c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.280192 Jul 21 08:30:18.764066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 4/7] 10.222.0.47 () {62 vars in 1199 bytes} [Thu Jul 21 08:30:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1284 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 08:30:22.242635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-233056693", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0007c58-da18-4da3-9b44-02b8eac8163c"}], "security_groups": [{"name": "tempest-securitygroup--933650263"}], "key_name": "tempest-keypair-1814532123", "user_data": "}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:22.711477 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] validate_networks() for [('f0007c58-da18-4da3-9b44-02b8eac8163c', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:30:26.381543 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:30:26.382251 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:30:26.382485 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:30:26.383074 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:30:26.383583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:30:26.438049 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:26.438507 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:26.449396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:26.454016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:26.546712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Getting quotas for project 1bae82711d354d908d096edaae82c2c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:30:26.569365 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Getting quotas for user ad56309db7044cb2a86651d4149cd090 and project 1bae82711d354d908d096edaae82c2c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:30:26.593754 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:30:26.601422 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:30:26.665708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2040891834", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "networks": [{"uuid": "93b56127-e5af-4f75-ac11-ea870ba6b474"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:26.807276 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-940a4240-343f-4052-99c6-a7c0563f7ccf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.602387 Jul 21 08:30:26.809321 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] validate_networks() for [('93b56127-e5af-4f75-ac11-ea870ba6b474', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:30:26.812000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 4/8] 10.222.0.47 () {62 vars in 1187 bytes} [Thu Jul 21 08:30:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 4608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 08:30:26.837696 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8c91d131-fa12-42d8-a749-db745bb67f6a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:26.838601 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8c91d131-fa12-42d8-a749-db745bb67f6a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:27.135313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8c91d131-fa12-42d8-a749-db745bb67f6a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:27.166986 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8c91d131-fa12-42d8-a749-db745bb67f6a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:27.176873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8c91d131-fa12-42d8-a749-db745bb67f6a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:27.178567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8c91d131-fa12-42d8-a749-db745bb67f6a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1281 microversion: 2.20 time: 0.359670 Jul 21 08:30:27.185804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 5/9] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:26 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1281 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:30:27.712065 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-560035505", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:27.858531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] validate_networks() for [('b2dadcd4-d21c-4f75-8863-8f3821dfa940', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:30:28.673598 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:29.018356 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:30:29.018943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:30:29.019785 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:30:29.020267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:30:29.020870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:30:29.058855 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:29.065397 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:29.071892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:29.074013 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:29.197173 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Getting quotas for project b27a1d777abf4d139048716280a4bb4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:30:29.217929 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Getting quotas for user 3528104f3e914d62a10e80e13d3c97de and project b27a1d777abf4d139048716280a4bb4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:30:29.286695 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:30:29.291540 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:30:29.403726 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-76675375-8f64-45b1-b351-b002c324f46f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.213595 Jul 21 08:30:29.410878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 6/10] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:30:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:30:29.426449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-aceefe6b-3e73-4d28-8a8f-06c6de3901c1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:29.436604 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-aceefe6b-3e73-4d28-8a8f-06c6de3901c1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:29.595360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-aceefe6b-3e73-4d28-8a8f-06c6de3901c1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:29.619741 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-aceefe6b-3e73-4d28-8a8f-06c6de3901c1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:29.628180 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-aceefe6b-3e73-4d28-8a8f-06c6de3901c1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:29.634567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-aceefe6b-3e73-4d28-8a8f-06c6de3901c1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1281 microversion: 2.20 time: 0.223143 Jul 21 08:30:29.636780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 7/11] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:29 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:29.647710 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b33f1a17-b6d6-4601-9e0d-eab93cf052ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:29.651764 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b33f1a17-b6d6-4601-9e0d-eab93cf052ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:29.831158 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b33f1a17-b6d6-4601-9e0d-eab93cf052ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:29.840389 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b33f1a17-b6d6-4601-9e0d-eab93cf052ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1221 microversion: 2.1 time: 0.201941 Jul 21 08:30:29.843478 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 8/12] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:29 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:30.030769 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:30:30.031553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:30:30.031719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:30:30.032135 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:30:30.032658 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:30:30.062090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:30.062090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:30.062090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:30.062090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:30.111891 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1223529331", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:30.116606 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Getting quotas for project 90d95f75c84d445f9ec31e4a0e8d3953. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:30:30.130124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Getting quotas for user 2465817c3ba340f4870debf937929499 and project 90d95f75c84d445f9ec31e4a0e8d3953. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:30:30.145938 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:30:30.149332 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:30:30.246068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] validate_networks() for [('b2dadcd4-d21c-4f75-8863-8f3821dfa940', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:30:30.304787 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2d692757-870e-498d-94f0-8f37c9a82619 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.048371 Jul 21 08:30:30.312668 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 5/13] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:30:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:30:30.319105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d92e5a2c-faa2-48c1-86a8-7e02b13f7aef tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:30.320780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d92e5a2c-faa2-48c1-86a8-7e02b13f7aef tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:31.282036 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d92e5a2c-faa2-48c1-86a8-7e02b13f7aef tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:31.321195 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d92e5a2c-faa2-48c1-86a8-7e02b13f7aef tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1215 microversion: 2.1 time: 1.004272 Jul 21 08:30:31.325711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 6/14] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:30 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1215 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:31.350437 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:31.353574 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:31.405376 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:31.408708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:31.409863 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:31.414826 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:32.053329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:30:32.054416 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:30:32.055089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:30:32.055687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:30:32.056247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:30:32.088288 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:32.088654 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:32.097777 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:32.097777 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:32.180720 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Getting quotas for project b27a1d777abf4d139048716280a4bb4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:30:32.190896 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Getting quotas for user 3528104f3e914d62a10e80e13d3c97de and project b27a1d777abf4d139048716280a4bb4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:30:32.227235 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:30:32.231249 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:30:32.427488 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cba717b4-340a-45ec-b0c2-7080325ba06b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.297363 Jul 21 08:30:32.433698 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 9/15] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:30:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 08:30:32.442695 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a3058b00-e0d5-4546-967b-0e57a70efd66 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:32.468466 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:32.473071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a3058b00-e0d5-4546-967b-0e57a70efd66 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:32.505224 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3058b00-e0d5-4546-967b-0e57a70efd66 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:32.517426 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3058b00-e0d5-4546-967b-0e57a70efd66 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:32.521816 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3058b00-e0d5-4546-967b-0e57a70efd66 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:32.528090 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3058b00-e0d5-4546-967b-0e57a70efd66 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:32.544506 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:32.552402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:32.557836 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6e619393-c036-46a6-b9fb-af06f8de812c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1333 microversion: 2.20 time: 1.227369 Jul 21 08:30:32.558836 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 7/16] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:31 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1333 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:32.573444 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d54cf0a3-c4a5-4951-8bce-3bb3f316bd16 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:32.574504 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d54cf0a3-c4a5-4951-8bce-3bb3f316bd16 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:32.792244 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d54cf0a3-c4a5-4951-8bce-3bb3f316bd16 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:32.801331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d54cf0a3-c4a5-4951-8bce-3bb3f316bd16 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1222 microversion: 2.1 time: 0.235597 Jul 21 08:30:32.803875 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 8/17] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:32 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1222 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:33.109509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a3058b00-e0d5-4546-967b-0e57a70efd66 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:33.174474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a3058b00-e0d5-4546-967b-0e57a70efd66 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1267 microversion: 2.1 time: 0.739365 Jul 21 08:30:33.177672 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 10/18] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:32 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1267 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:33.578014 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:33.578624 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:33.595073 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:33.596162 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:33.599456 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:33.600147 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:33.821798 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-964cdea7-4cc9-4a29-a728-e694398512a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:33.822151 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-964cdea7-4cc9-4a29-a728-e694398512a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:33.838109 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-964cdea7-4cc9-4a29-a728-e694398512a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:33.838549 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-964cdea7-4cc9-4a29-a728-e694398512a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:33.854979 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-964cdea7-4cc9-4a29-a728-e694398512a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:33.855741 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-964cdea7-4cc9-4a29-a728-e694398512a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:33.869409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:33.895900 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:33.915356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:33.920613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fcc86c77-dd0c-44e3-9964-c46f6ea90390 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1339 microversion: 2.20 time: 0.345722 Jul 21 08:30:33.926918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 9/19] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:33 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1339 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:34.196605 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-554b9de2-194f-4935-a52d-5392fc4067d6 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:34.197317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-554b9de2-194f-4935-a52d-5392fc4067d6 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:34.208605 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-554b9de2-194f-4935-a52d-5392fc4067d6 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:34.225564 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-554b9de2-194f-4935-a52d-5392fc4067d6 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:34.235575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-554b9de2-194f-4935-a52d-5392fc4067d6 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:34.240821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-554b9de2-194f-4935-a52d-5392fc4067d6 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:34.447962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-964cdea7-4cc9-4a29-a728-e694398512a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:34.460177 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-964cdea7-4cc9-4a29-a728-e694398512a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1226 microversion: 2.1 time: 0.643126 Jul 21 08:30:34.460768 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 11/20] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:33 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1226 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:30:34.946388 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:34.948433 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:34.966466 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:34.966962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:34.975439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:34.975796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:35.266613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-554b9de2-194f-4935-a52d-5392fc4067d6 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:35.287276 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-554b9de2-194f-4935-a52d-5392fc4067d6 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1273 microversion: 2.1 time: 1.094631 Jul 21 08:30:35.288841 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 10/21] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:34 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1273 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:30:35.486488 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd65585b-d9eb-4040-b6ed-2c52fa4f15bf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:35.487510 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd65585b-d9eb-4040-b6ed-2c52fa4f15bf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:35.514040 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd65585b-d9eb-4040-b6ed-2c52fa4f15bf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:35.515276 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd65585b-d9eb-4040-b6ed-2c52fa4f15bf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:35.529295 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd65585b-d9eb-4040-b6ed-2c52fa4f15bf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:35.531920 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd65585b-d9eb-4040-b6ed-2c52fa4f15bf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:36.216628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd65585b-d9eb-4040-b6ed-2c52fa4f15bf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:36.245344 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd65585b-d9eb-4040-b6ed-2c52fa4f15bf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1282 microversion: 2.1 time: 0.766527 Jul 21 08:30:36.246620 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 11/22] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:35 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1282 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:36.306299 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9889d0a8-5f80-4d73-9e38-4dbfe38b1403 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:36.307412 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9889d0a8-5f80-4d73-9e38-4dbfe38b1403 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:36.335464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9889d0a8-5f80-4d73-9e38-4dbfe38b1403 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:36.339484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9889d0a8-5f80-4d73-9e38-4dbfe38b1403 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:36.349206 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9889d0a8-5f80-4d73-9e38-4dbfe38b1403 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:36.354177 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9889d0a8-5f80-4d73-9e38-4dbfe38b1403 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:36.838893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:36.870505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:36.878046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:36.883698 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ad32cd61-97f0-46bc-b602-ccae2c5bb4f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1339 microversion: 2.20 time: 1.941574 Jul 21 08:30:36.895818 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 12/23] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:34 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1339 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:37.015514 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9889d0a8-5f80-4d73-9e38-4dbfe38b1403 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:37.030666 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9889d0a8-5f80-4d73-9e38-4dbfe38b1403 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1273 microversion: 2.1 time: 0.727791 Jul 21 08:30:37.035591 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 12/24] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:36 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1273 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:37.264855 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e30f96e1-5a8f-4a09-bde8-19ec389d4d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:37.267031 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e30f96e1-5a8f-4a09-bde8-19ec389d4d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:37.286349 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e30f96e1-5a8f-4a09-bde8-19ec389d4d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:37.287205 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e30f96e1-5a8f-4a09-bde8-19ec389d4d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:37.288272 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e30f96e1-5a8f-4a09-bde8-19ec389d4d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:37.290224 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e30f96e1-5a8f-4a09-bde8-19ec389d4d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:37.902608 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:37.903944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:37.907677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e30f96e1-5a8f-4a09-bde8-19ec389d4d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:37.922192 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e30f96e1-5a8f-4a09-bde8-19ec389d4d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1280 microversion: 2.1 time: 0.660573 Jul 21 08:30:37.922517 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:37.923000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:37 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1280 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:37.923711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:37.929270 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:37.930364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:38.053186 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-27f35979-38e7-4015-aab7-114af376afcd tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:38.053998 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-27f35979-38e7-4015-aab7-114af376afcd tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:38.065875 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-27f35979-38e7-4015-aab7-114af376afcd tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:38.066459 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-27f35979-38e7-4015-aab7-114af376afcd tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:38.068283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-27f35979-38e7-4015-aab7-114af376afcd tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:38.070048 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-27f35979-38e7-4015-aab7-114af376afcd tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:38.634958 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:38.668211 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:38.672006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:38.678784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa2be87e-d07f-4af0-a060-ce00192f3be6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1339 microversion: 2.20 time: 0.780105 Jul 21 08:30:38.697167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 13/26] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:37 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1339 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:38.942677 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b93499e-e138-45eb-91e9-2526a291fc98 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:38.945508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b93499e-e138-45eb-91e9-2526a291fc98 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:38.958590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b93499e-e138-45eb-91e9-2526a291fc98 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:38.959286 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b93499e-e138-45eb-91e9-2526a291fc98 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:38.961312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b93499e-e138-45eb-91e9-2526a291fc98 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:38.982615 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b93499e-e138-45eb-91e9-2526a291fc98 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:39.594416 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b93499e-e138-45eb-91e9-2526a291fc98 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:39.607317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b93499e-e138-45eb-91e9-2526a291fc98 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1280 microversion: 2.1 time: 0.670235 Jul 21 08:30:39.608235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 14/27] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:38 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1280 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:39.706095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:39.708305 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:39.725347 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:39.732064 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:39.738506 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:39.742330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:40.097980 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:41.410001 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:41.426590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:41.434380 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:41.449236 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c29b5ed-f8b9-418c-8e3c-42f861c73c87 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 1.748624 Jul 21 08:30:41.463957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 15/28] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:39 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:41.506463 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1341fcd1-61de-4527-9438-cd92302353e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:41.508451 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1341fcd1-61de-4527-9438-cd92302353e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:41.559597 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1341fcd1-61de-4527-9438-cd92302353e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:41.563080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1341fcd1-61de-4527-9438-cd92302353e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:41.563080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1341fcd1-61de-4527-9438-cd92302353e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:41.563080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1341fcd1-61de-4527-9438-cd92302353e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:41.850391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-27f35979-38e7-4015-aab7-114af376afcd tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:41.862448 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-27f35979-38e7-4015-aab7-114af376afcd tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 3.814903 Jul 21 08:30:41.865190 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 14/29] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:38 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 3818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:42.468087 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:42.469369 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=24 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:42.477245 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:42.478801 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:42.526964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:42.527596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:42.537647 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:42.539147 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:42.800622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=10 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:44.521011 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:44.552042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:44.566607 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:44.568149 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-54c2bae7-46dd-4e40-a29e-53e1e2a81fef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 2.101360 Jul 21 08:30:44.574666 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 15/30] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:42 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:44.588836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3d6f5171-3a7c-4161-9d04-4acb3617f35e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:44.598179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3d6f5171-3a7c-4161-9d04-4acb3617f35e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:44.614244 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:44.636124 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d6f5171-3a7c-4161-9d04-4acb3617f35e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:44.639919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d6f5171-3a7c-4161-9d04-4acb3617f35e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:44.643398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d6f5171-3a7c-4161-9d04-4acb3617f35e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:44.644659 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d6f5171-3a7c-4161-9d04-4acb3617f35e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:44.817076 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1341fcd1-61de-4527-9438-cd92302353e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:44.825422 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1341fcd1-61de-4527-9438-cd92302353e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 3.360255 Jul 21 08:30:44.828559 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 16/31] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:41 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 3364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:45.359055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-22cfbb7a-45bc-404d-a69e-6a17a68bf63f req-e619b329-8650-491f-a7cb-ec8c4670fa20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a142cdd4-307c-476e-a178-54914626cda0", "tag": "6c401b8c-2f91-49c6-acfe-52333748b0c9"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:45.382768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-22cfbb7a-45bc-404d-a69e-6a17a68bf63f req-e619b329-8650-491f-a7cb-ec8c4670fa20 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:45.385948 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-22cfbb7a-45bc-404d-a69e-6a17a68bf63f req-e619b329-8650-491f-a7cb-ec8c4670fa20 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:45.436079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-22cfbb7a-45bc-404d-a69e-6a17a68bf63f req-e619b329-8650-491f-a7cb-ec8c4670fa20 service nova] Creating event network-changed:6c401b8c-2f91-49c6-acfe-52333748b0c9 for instance a142cdd4-307c-476e-a178-54914626cda0 on hv-cinder-85032 Jul 21 08:30:45.438286 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-22cfbb7a-45bc-404d-a69e-6a17a68bf63f req-e619b329-8650-491f-a7cb-ec8c4670fa20 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 08:30:45.442000 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7c7d09-296e-43fc-8f5b-d276719b4029 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:45.443237 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7c7d09-296e-43fc-8f5b-d276719b4029 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:45.452568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7c7d09-296e-43fc-8f5b-d276719b4029 None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:45.457283 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7c7d09-296e-43fc-8f5b-d276719b4029 None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:45.503782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.compute.rpcapi [None req-af7c7d09-296e-43fc-8f5b-d276719b4029 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 08:30:45.505050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af7c7d09-296e-43fc-8f5b-d276719b4029 None None] Releasing lock "compute-rpcapi-router" {{(pid=117951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 08:30:45.552436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af7c7d09-296e-43fc-8f5b-d276719b4029 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.435472 Jul 21 08:30:45.553788 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:30:45.596962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:45.608061 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:45.629893 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:45.630612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:45.631603 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:45.632257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:45.789538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3d6f5171-3a7c-4161-9d04-4acb3617f35e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:45.798483 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3d6f5171-3a7c-4161-9d04-4acb3617f35e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 1.222682 Jul 21 08:30:45.801015 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 16/33] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:44 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:45.845762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-93845317-0325-4e8c-bb0c-3305a83420ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:45.846378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-93845317-0325-4e8c-bb0c-3305a83420ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:45.860099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93845317-0325-4e8c-bb0c-3305a83420ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:45.860548 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93845317-0325-4e8c-bb0c-3305a83420ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:45.861399 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93845317-0325-4e8c-bb0c-3305a83420ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:45.862003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93845317-0325-4e8c-bb0c-3305a83420ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:46.643858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:46.666462 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:46.671551 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:46.683485 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-93845317-0325-4e8c-bb0c-3305a83420ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:46.693804 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f97c7d17-f5d1-4627-8169-41e92a9b5b6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 1.102678 Jul 21 08:30:46.699698 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-93845317-0325-4e8c-bb0c-3305a83420ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.858409 Jul 21 08:30:46.700398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 17/34] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:45 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:30:46.714908 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 18/35] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:45 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:30:46.819809 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-158b3d32-c01d-4f12-b6b8-a0240da2dd11 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:46.820433 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-158b3d32-c01d-4f12-b6b8-a0240da2dd11 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:46.834968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-158b3d32-c01d-4f12-b6b8-a0240da2dd11 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:46.835518 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-158b3d32-c01d-4f12-b6b8-a0240da2dd11 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:46.839155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-158b3d32-c01d-4f12-b6b8-a0240da2dd11 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:46.841143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-158b3d32-c01d-4f12-b6b8-a0240da2dd11 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.277858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-158b3d32-c01d-4f12-b6b8-a0240da2dd11 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:47.286850 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-158b3d32-c01d-4f12-b6b8-a0240da2dd11 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.473000 Jul 21 08:30:47.295261 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 18/36] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:46 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:47.450462 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-ddd1b424-f19a-4af9-a9d6-9a8ddd85eb52 req-f9af70f4-cc8e-48bb-aa3e-a467f2db96d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2248844f-40e4-41cb-aa40-cdd614390793", "tag": "411d3f73-9846-4340-8e3f-ffc3a9ff1fa5"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:47.463041 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ddd1b424-f19a-4af9-a9d6-9a8ddd85eb52 req-f9af70f4-cc8e-48bb-aa3e-a467f2db96d5 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:47.463707 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ddd1b424-f19a-4af9-a9d6-9a8ddd85eb52 req-f9af70f4-cc8e-48bb-aa3e-a467f2db96d5 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.476929 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-ddd1b424-f19a-4af9-a9d6-9a8ddd85eb52 req-f9af70f4-cc8e-48bb-aa3e-a467f2db96d5 service nova] Creating event network-changed:411d3f73-9846-4340-8e3f-ffc3a9ff1fa5 for instance 2248844f-40e4-41cb-aa40-cdd614390793 on hv-cinder-85032 Jul 21 08:30:47.483076 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-ddd1b424-f19a-4af9-a9d6-9a8ddd85eb52 req-f9af70f4-cc8e-48bb-aa3e-a467f2db96d5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184021 Jul 21 08:30:47.484385 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 19/37] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:30:47.588560 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-514bf751-c37c-4ae2-b0e5-b3cc95c0f48e req-a4e341a6-4c4b-4971-83b6-1a72ae8ae249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a", "tag": "dc3ec772-1aa6-40c5-a783-9c70e0e921dd"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:47.601348 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-514bf751-c37c-4ae2-b0e5-b3cc95c0f48e req-a4e341a6-4c4b-4971-83b6-1a72ae8ae249 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:47.601784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-514bf751-c37c-4ae2-b0e5-b3cc95c0f48e req-a4e341a6-4c4b-4971-83b6-1a72ae8ae249 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.621320 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-514bf751-c37c-4ae2-b0e5-b3cc95c0f48e req-a4e341a6-4c4b-4971-83b6-1a72ae8ae249 service nova] Creating event network-changed:dc3ec772-1aa6-40c5-a783-9c70e0e921dd for instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a on hv-cinder-85032 Jul 21 08:30:47.621803 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-514bf751-c37c-4ae2-b0e5-b3cc95c0f48e req-a4e341a6-4c4b-4971-83b6-1a72ae8ae249 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117950) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 08:30:47.623460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bfda471-4c87-46f3-aa7e-e088d259ea4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:47.623972 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bfda471-4c87-46f3-aa7e-e088d259ea4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.624704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bfda471-4c87-46f3-aa7e-e088d259ea4f None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:47.625128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bfda471-4c87-46f3-aa7e-e088d259ea4f None None] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.634312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.compute.rpcapi [None req-2bfda471-4c87-46f3-aa7e-e088d259ea4f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 08:30:47.635196 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bfda471-4c87-46f3-aa7e-e088d259ea4f None None] Releasing lock "compute-rpcapi-router" {{(pid=117950) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 08:30:47.651682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2bfda471-4c87-46f3-aa7e-e088d259ea4f None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066434 Jul 21 08:30:47.652479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 19/38] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:30:47.717557 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-312f7df8-d172-4a9c-997a-29e2b6a7cf49 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:47.718276 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-312f7df8-d172-4a9c-997a-29e2b6a7cf49 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:47.721381 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:47.722116 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:47.733713 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:47.734172 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.734960 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:47.735408 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.737688 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-312f7df8-d172-4a9c-997a-29e2b6a7cf49 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:47.738219 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-312f7df8-d172-4a9c-997a-29e2b6a7cf49 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.739088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-312f7df8-d172-4a9c-997a-29e2b6a7cf49 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:47.739600 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-312f7df8-d172-4a9c-997a-29e2b6a7cf49 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:47.917121 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-312f7df8-d172-4a9c-997a-29e2b6a7cf49 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:47.923406 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:47.927699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-312f7df8-d172-4a9c-997a-29e2b6a7cf49 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.212672 Jul 21 08:30:47.930653 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 20/39] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:47 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:30:47.932391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:47.933960 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:47.935076 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3af211b4-94ea-41e9-b247-a0169539a4b6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.226429 Jul 21 08:30:47.935747 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 20/40] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:47 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:48.306854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-de844d23-8eb8-4f2b-8df4-0aceb3e64e1e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:48.307524 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-de844d23-8eb8-4f2b-8df4-0aceb3e64e1e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:48.314137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de844d23-8eb8-4f2b-8df4-0aceb3e64e1e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:48.314791 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de844d23-8eb8-4f2b-8df4-0aceb3e64e1e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:48.315595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de844d23-8eb8-4f2b-8df4-0aceb3e64e1e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:48.316221 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de844d23-8eb8-4f2b-8df4-0aceb3e64e1e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:48.463980 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-de844d23-8eb8-4f2b-8df4-0aceb3e64e1e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:48.479174 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-de844d23-8eb8-4f2b-8df4-0aceb3e64e1e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.172252 Jul 21 08:30:48.479174 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 21/41] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:48 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:48.949848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-35d929db-78c6-4ab3-abe1-0a5e92dc0cc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:48.950597 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-35d929db-78c6-4ab3-abe1-0a5e92dc0cc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:48.953694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:48.954516 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:48.957328 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:48.959265 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35d929db-78c6-4ab3-abe1-0a5e92dc0cc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:48.959812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35d929db-78c6-4ab3-abe1-0a5e92dc0cc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:48.960638 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35d929db-78c6-4ab3-abe1-0a5e92dc0cc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:48.961253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35d929db-78c6-4ab3-abe1-0a5e92dc0cc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:48.963083 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:48.963748 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:48.964761 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:48.965484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:49.267839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-35d929db-78c6-4ab3-abe1-0a5e92dc0cc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:49.269216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:49.287295 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-35d929db-78c6-4ab3-abe1-0a5e92dc0cc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.340496 Jul 21 08:30:49.288813 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:49.289420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 21/42] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:48 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:49.292035 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:49.293899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9ed49612-cd71-441e-9dfa-abade81e1e72 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.344445 Jul 21 08:30:49.305042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 22/43] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:48 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:49.498537 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54299dd6-576b-4bb9-8248-bfded7ab3bae tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:49.499173 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54299dd6-576b-4bb9-8248-bfded7ab3bae tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:49.500109 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-8a328015-33b3-4fb5-b8d1-e52c00abf260 req-a092882c-2ccd-48ad-9677-2af38950c107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284babfb-5c35-4312-ad28-7af7026b4f51", "tag": "13bfbdd0-2bcd-4e96-9be4-7eea28463ac1"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:30:49.506330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54299dd6-576b-4bb9-8248-bfded7ab3bae tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:49.506330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54299dd6-576b-4bb9-8248-bfded7ab3bae tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:49.507050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54299dd6-576b-4bb9-8248-bfded7ab3bae tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:49.507527 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54299dd6-576b-4bb9-8248-bfded7ab3bae tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:49.509500 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-8a328015-33b3-4fb5-b8d1-e52c00abf260 req-a092882c-2ccd-48ad-9677-2af38950c107 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:49.510081 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-8a328015-33b3-4fb5-b8d1-e52c00abf260 req-a092882c-2ccd-48ad-9677-2af38950c107 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:49.526090 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-8a328015-33b3-4fb5-b8d1-e52c00abf260 req-a092882c-2ccd-48ad-9677-2af38950c107 service nova] Creating event network-changed:13bfbdd0-2bcd-4e96-9be4-7eea28463ac1 for instance 284babfb-5c35-4312-ad28-7af7026b4f51 on hv-cinder-85032 Jul 21 08:30:49.532005 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-8a328015-33b3-4fb5-b8d1-e52c00abf260 req-a092882c-2ccd-48ad-9677-2af38950c107 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037227 Jul 21 08:30:49.533283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 23/44] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:30:49.673655 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-54299dd6-576b-4bb9-8248-bfded7ab3bae tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:49.681642 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54299dd6-576b-4bb9-8248-bfded7ab3bae tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.188516 Jul 21 08:30:49.693366 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 22/45] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:49 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:50.311129 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-362f581c-664b-4596-b2f5-10c46be02043 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:50.311945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-362f581c-664b-4596-b2f5-10c46be02043 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:50.318784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:50.319904 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:50.328822 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-362f581c-664b-4596-b2f5-10c46be02043 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:50.329169 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-362f581c-664b-4596-b2f5-10c46be02043 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:50.330308 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-362f581c-664b-4596-b2f5-10c46be02043 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:50.330904 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-362f581c-664b-4596-b2f5-10c46be02043 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:50.333762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:50.335003 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:50.336640 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:50.337822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:50.595083 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-362f581c-664b-4596-b2f5-10c46be02043 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:50.604044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-362f581c-664b-4596-b2f5-10c46be02043 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.297817 Jul 21 08:30:50.605781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 24/46] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:50 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:30:50.634577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:50.657445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:50.659946 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:50.661345 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1cfab95-a838-44db-88b5-b5097914fb37 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.348320 Jul 21 08:30:50.662056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:50 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:50.702136 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-da3a1661-637b-4d4d-a55f-659b912f908b tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:50.703149 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-da3a1661-637b-4d4d-a55f-659b912f908b tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:50.711514 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-da3a1661-637b-4d4d-a55f-659b912f908b tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:50.711963 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-da3a1661-637b-4d4d-a55f-659b912f908b tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:50.712740 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-da3a1661-637b-4d4d-a55f-659b912f908b tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:50.713203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-da3a1661-637b-4d4d-a55f-659b912f908b tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:50.976884 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-da3a1661-637b-4d4d-a55f-659b912f908b tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:51.006190 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-da3a1661-637b-4d4d-a55f-659b912f908b tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.310421 Jul 21 08:30:51.006971 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 25/48] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:50 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:51.622062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b8e693d4-87b6-49a8-9353-a2359517f1bd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:51.623270 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b8e693d4-87b6-49a8-9353-a2359517f1bd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:51.629465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8e693d4-87b6-49a8-9353-a2359517f1bd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:51.630853 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8e693d4-87b6-49a8-9353-a2359517f1bd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:51.630853 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8e693d4-87b6-49a8-9353-a2359517f1bd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:51.631057 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8e693d4-87b6-49a8-9353-a2359517f1bd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:51.679510 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:51.680222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:51.686880 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:51.687446 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:51.688280 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:51.688781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:51.707858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:51.825132 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:51.833767 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:51.835301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:51.836447 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d16d427d-ca2e-468a-9110-5fcc9340d5d3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.160834 Jul 21 08:30:51.837006 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 26/49] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:51 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:30:51.919496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b8e693d4-87b6-49a8-9353-a2359517f1bd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:51.926702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b8e693d4-87b6-49a8-9353-a2359517f1bd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.308538 Jul 21 08:30:51.927257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 24/50] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:51 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:52.023881 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5e9e2eab-bc76-4ea0-9671-dc9fa47a85de tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:52.024569 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5e9e2eab-bc76-4ea0-9671-dc9fa47a85de tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:52.035797 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e9e2eab-bc76-4ea0-9671-dc9fa47a85de tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:52.036257 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e9e2eab-bc76-4ea0-9671-dc9fa47a85de tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:52.040016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e9e2eab-bc76-4ea0-9671-dc9fa47a85de tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:52.040681 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e9e2eab-bc76-4ea0-9671-dc9fa47a85de tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:52.194125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5e9e2eab-bc76-4ea0-9671-dc9fa47a85de tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:52.204461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5e9e2eab-bc76-4ea0-9671-dc9fa47a85de tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.184380 Jul 21 08:30:52.205325 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 27/51] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:52 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:52.854078 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:52.854739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:52.861425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:52.861810 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:52.862643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:52.863075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:52.867246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:52.945196 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0b67f7e0-126b-4fad-9701-7b90e57aaa92 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:52.947454 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0b67f7e0-126b-4fad-9701-7b90e57aaa92 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:52.956055 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b67f7e0-126b-4fad-9701-7b90e57aaa92 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:52.957452 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b67f7e0-126b-4fad-9701-7b90e57aaa92 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:52.958443 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b67f7e0-126b-4fad-9701-7b90e57aaa92 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:52.959159 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b67f7e0-126b-4fad-9701-7b90e57aaa92 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:53.052371 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:53.061294 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:53.064023 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:53.068428 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-972e1c11-86fe-46e2-be6b-067df6d2594e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.218119 Jul 21 08:30:53.080375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 25/52] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:52 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:53.112233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0b67f7e0-126b-4fad-9701-7b90e57aaa92 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:53.127618 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0b67f7e0-126b-4fad-9701-7b90e57aaa92 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.187339 Jul 21 08:30:53.128365 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 28/53] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:52 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:30:53.222347 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a2f35a5f-d253-4f9b-8638-34626e456139 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:53.222951 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a2f35a5f-d253-4f9b-8638-34626e456139 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:53.229874 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2f35a5f-d253-4f9b-8638-34626e456139 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:53.230242 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2f35a5f-d253-4f9b-8638-34626e456139 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:53.231028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2f35a5f-d253-4f9b-8638-34626e456139 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:53.231519 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2f35a5f-d253-4f9b-8638-34626e456139 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:53.407811 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a2f35a5f-d253-4f9b-8638-34626e456139 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:53.416062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a2f35a5f-d253-4f9b-8638-34626e456139 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.197369 Jul 21 08:30:53.416649 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 26/54] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:53 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:54.087860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:54.088493 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:54.094419 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:54.095128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:54.095933 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:54.096366 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:54.147214 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af48e7b0-c3ce-4d5a-b963-fbb5fcf55987 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:54.147961 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af48e7b0-c3ce-4d5a-b963-fbb5fcf55987 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:54.153805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af48e7b0-c3ce-4d5a-b963-fbb5fcf55987 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:54.154253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af48e7b0-c3ce-4d5a-b963-fbb5fcf55987 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:54.155020 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af48e7b0-c3ce-4d5a-b963-fbb5fcf55987 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:54.155484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af48e7b0-c3ce-4d5a-b963-fbb5fcf55987 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:54.251203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:54.262407 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:54.264572 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:54.266063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-343c95d4-4c4d-4431-9c54-a7b112433340 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.182112 Jul 21 08:30:54.266816 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 29/55] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:54 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:54.320367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-af48e7b0-c3ce-4d5a-b963-fbb5fcf55987 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:54.328199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af48e7b0-c3ce-4d5a-b963-fbb5fcf55987 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.184752 Jul 21 08:30:54.328781 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 27/56] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:54 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:30:54.433215 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c5a76428-4b50-42bb-bf89-7c40ad715c1f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:54.433935 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c5a76428-4b50-42bb-bf89-7c40ad715c1f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:54.439884 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5a76428-4b50-42bb-bf89-7c40ad715c1f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:54.440338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5a76428-4b50-42bb-bf89-7c40ad715c1f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:54.441115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5a76428-4b50-42bb-bf89-7c40ad715c1f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:54.441550 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5a76428-4b50-42bb-bf89-7c40ad715c1f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:54.578401 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c5a76428-4b50-42bb-bf89-7c40ad715c1f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:54.585880 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c5a76428-4b50-42bb-bf89-7c40ad715c1f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.156463 Jul 21 08:30:54.586457 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 30/57] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:54 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:55.283828 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:55.284422 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:55.290452 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:55.291101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:55.291901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:55.292339 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:55.344333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ea48b89d-d7e3-4980-918f-632f4667792a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:55.344959 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ea48b89d-d7e3-4980-918f-632f4667792a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:55.359268 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea48b89d-d7e3-4980-918f-632f4667792a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:55.361329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea48b89d-d7e3-4980-918f-632f4667792a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:55.363208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea48b89d-d7e3-4980-918f-632f4667792a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:55.365241 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea48b89d-d7e3-4980-918f-632f4667792a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:55.492282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:55.798812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:55.813577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:55.816470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:55.818113 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b00b72bb-ed9a-4d12-adb9-88134462ef95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.537789 Jul 21 08:30:55.820150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 28/58] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:55 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:55.827928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfdf0318-1506-4920-add6-6dd5a35f65a9 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:55.828728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfdf0318-1506-4920-add6-6dd5a35f65a9 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:55.836444 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfdf0318-1506-4920-add6-6dd5a35f65a9 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:55.837243 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfdf0318-1506-4920-add6-6dd5a35f65a9 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:55.838146 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfdf0318-1506-4920-add6-6dd5a35f65a9 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:55.838887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfdf0318-1506-4920-add6-6dd5a35f65a9 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:55.926172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ea48b89d-d7e3-4980-918f-632f4667792a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:55.952141 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ea48b89d-d7e3-4980-918f-632f4667792a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.611305 Jul 21 08:30:55.954964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:55 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:56.423564 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfdf0318-1506-4920-add6-6dd5a35f65a9 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:56.434716 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfdf0318-1506-4920-add6-6dd5a35f65a9 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.611721 Jul 21 08:30:56.435372 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 29/60] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:55 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:56.839809 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:56.841364 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:56.848212 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:56.849040 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:56.850377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:56.851713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:56.978430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50b2256e-9db4-475a-92ed-40751d3dddb0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:56.981391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50b2256e-9db4-475a-92ed-40751d3dddb0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:56.994195 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50b2256e-9db4-475a-92ed-40751d3dddb0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:56.995233 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50b2256e-9db4-475a-92ed-40751d3dddb0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:56.996199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50b2256e-9db4-475a-92ed-40751d3dddb0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:56.996726 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50b2256e-9db4-475a-92ed-40751d3dddb0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:57.045470 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:57.055595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:57.058893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:57.061119 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6bcb240a-0b4a-4a1d-945d-6d9c39abbec7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.228027 Jul 21 08:30:57.061683 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 32/61] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:56 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:57.299971 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-50b2256e-9db4-475a-92ed-40751d3dddb0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:57.314448 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50b2256e-9db4-475a-92ed-40751d3dddb0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.345238 Jul 21 08:30:57.315952 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 30/62] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:56 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:57.451586 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-14af019f-2fe5-4db4-84d0-88687ae1278e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:57.452907 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-14af019f-2fe5-4db4-84d0-88687ae1278e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:57.460143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-14af019f-2fe5-4db4-84d0-88687ae1278e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:57.461187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-14af019f-2fe5-4db4-84d0-88687ae1278e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:57.462498 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-14af019f-2fe5-4db4-84d0-88687ae1278e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:57.463176 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-14af019f-2fe5-4db4-84d0-88687ae1278e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:57.632728 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:57.849524 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-14af019f-2fe5-4db4-84d0-88687ae1278e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:57.858378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-14af019f-2fe5-4db4-84d0-88687ae1278e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.411351 Jul 21 08:30:57.858968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 33/63] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:57 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:58.078352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:58.079507 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:58.085774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:58.086486 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:58.087522 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:58.088174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:58.273223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:58.282236 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:58.283993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:58.285462 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5238ec52-c944-4507-b6ef-140754fc6fc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.210981 Jul 21 08:30:58.286017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 31/64] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:58 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:58.331908 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7bd539e6-1ba9-45f8-b670-f20f848bb42f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:58.332891 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7bd539e6-1ba9-45f8-b670-f20f848bb42f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:58.352582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bd539e6-1ba9-45f8-b670-f20f848bb42f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:58.353396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bd539e6-1ba9-45f8-b670-f20f848bb42f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:58.354393 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bd539e6-1ba9-45f8-b670-f20f848bb42f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:58.354899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bd539e6-1ba9-45f8-b670-f20f848bb42f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:58.572273 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7bd539e6-1ba9-45f8-b670-f20f848bb42f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:58.581402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7bd539e6-1ba9-45f8-b670-f20f848bb42f tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.253198 Jul 21 08:30:58.582190 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 34/65] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:58 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:58.875821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ce17b97-0979-481b-8fc0-9035b34c7423 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:58.879446 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ce17b97-0979-481b-8fc0-9035b34c7423 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:58.884711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce17b97-0979-481b-8fc0-9035b34c7423 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:58.885008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce17b97-0979-481b-8fc0-9035b34c7423 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:58.885776 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce17b97-0979-481b-8fc0-9035b34c7423 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:58.886204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce17b97-0979-481b-8fc0-9035b34c7423 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:59.044543 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ce17b97-0979-481b-8fc0-9035b34c7423 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:59.053226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ce17b97-0979-481b-8fc0-9035b34c7423 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.181497 Jul 21 08:30:59.053944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:58 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:30:59.303806 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:59.305004 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:59.312519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:59.313243 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:59.314266 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:59.314882 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:59.472877 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:59.484607 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:59.487533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:59.489083 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-98f89f62-f33f-4d13-a007-b38a2c0b632d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.189479 Jul 21 08:30:59.490544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 35/67] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:30:59 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:30:59.597894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-061971f9-a810-4dcd-a34d-d6e4a1765b9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:30:59.598474 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-061971f9-a810-4dcd-a34d-d6e4a1765b9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:30:59.604460 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-061971f9-a810-4dcd-a34d-d6e4a1765b9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:59.604794 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-061971f9-a810-4dcd-a34d-d6e4a1765b9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:59.605561 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-061971f9-a810-4dcd-a34d-d6e4a1765b9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:30:59.605972 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-061971f9-a810-4dcd-a34d-d6e4a1765b9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:30:59.773433 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-061971f9-a810-4dcd-a34d-d6e4a1765b9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:30:59.792718 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-061971f9-a810-4dcd-a34d-d6e4a1765b9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.198249 Jul 21 08:30:59.793396 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 33/68] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:30:59 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:00.072016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5967a22b-5e09-46e8-aedb-9544fee7ebde tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:00.072530 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5967a22b-5e09-46e8-aedb-9544fee7ebde tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:00.079157 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5967a22b-5e09-46e8-aedb-9544fee7ebde tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:00.079645 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5967a22b-5e09-46e8-aedb-9544fee7ebde tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:00.080421 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5967a22b-5e09-46e8-aedb-9544fee7ebde tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:00.080856 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5967a22b-5e09-46e8-aedb-9544fee7ebde tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:00.454970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5967a22b-5e09-46e8-aedb-9544fee7ebde tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:00.462354 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5967a22b-5e09-46e8-aedb-9544fee7ebde tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.394279 Jul 21 08:31:00.462925 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 36/69] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:00 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:00.509019 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:00.509641 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:00.516371 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:00.517104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:00.517886 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:00.518442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:00.687658 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:00.698666 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:00.700443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:00.702775 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f77f528d-477b-4ca0-b454-3f5cfc86d040 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.198323 Jul 21 08:31:00.703973 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 34/70] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:00 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:00.817515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a2be2181-5c91-41be-841c-97ef96d26da7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:00.818935 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a2be2181-5c91-41be-841c-97ef96d26da7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:00.828419 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a2be2181-5c91-41be-841c-97ef96d26da7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:00.828878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a2be2181-5c91-41be-841c-97ef96d26da7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:00.829724 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a2be2181-5c91-41be-841c-97ef96d26da7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:00.830165 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a2be2181-5c91-41be-841c-97ef96d26da7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:01.000167 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a2be2181-5c91-41be-841c-97ef96d26da7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:01.008141 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a2be2181-5c91-41be-841c-97ef96d26da7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.199187 Jul 21 08:31:01.008732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 37/71] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:00 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:01.479781 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b56a3cf-6c22-4fe1-b8a4-52753e22dc1c tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:01.480465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b56a3cf-6c22-4fe1-b8a4-52753e22dc1c tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:01.487180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b56a3cf-6c22-4fe1-b8a4-52753e22dc1c tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:01.487673 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b56a3cf-6c22-4fe1-b8a4-52753e22dc1c tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:01.488442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b56a3cf-6c22-4fe1-b8a4-52753e22dc1c tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:01.488875 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b56a3cf-6c22-4fe1-b8a4-52753e22dc1c tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:01.618373 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b56a3cf-6c22-4fe1-b8a4-52753e22dc1c tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:01.626509 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b56a3cf-6c22-4fe1-b8a4-52753e22dc1c tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.150653 Jul 21 08:31:01.627081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 35/72] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:01 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:01.721743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:01.722364 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:01.729144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:01.729924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:01.730660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:01.731097 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:01.869208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:01.882391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:01.884208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:01.885370 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a3f76053-d3e8-40e9-90a9-f5d5345485c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.167675 Jul 21 08:31:01.885959 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 38/73] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:01 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:02.026133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-229ac18e-e6ab-47be-97f8-9d75c0038bac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:02.026742 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-229ac18e-e6ab-47be-97f8-9d75c0038bac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:02.033240 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-229ac18e-e6ab-47be-97f8-9d75c0038bac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:02.033679 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-229ac18e-e6ab-47be-97f8-9d75c0038bac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:02.034441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-229ac18e-e6ab-47be-97f8-9d75c0038bac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:02.034863 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-229ac18e-e6ab-47be-97f8-9d75c0038bac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:02.172718 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-229ac18e-e6ab-47be-97f8-9d75c0038bac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:02.180049 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-229ac18e-e6ab-47be-97f8-9d75c0038bac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.157709 Jul 21 08:31:02.180641 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 36/74] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:02 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:02.643830 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-100104b2-ccf4-4ee5-bf3b-de982aa74117 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:02.644447 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-100104b2-ccf4-4ee5-bf3b-de982aa74117 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:02.650495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-100104b2-ccf4-4ee5-bf3b-de982aa74117 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:02.650941 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-100104b2-ccf4-4ee5-bf3b-de982aa74117 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:02.651741 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-100104b2-ccf4-4ee5-bf3b-de982aa74117 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:02.652181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-100104b2-ccf4-4ee5-bf3b-de982aa74117 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:02.783034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-100104b2-ccf4-4ee5-bf3b-de982aa74117 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:02.790527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-100104b2-ccf4-4ee5-bf3b-de982aa74117 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.150491 Jul 21 08:31:02.791099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 39/75] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:02 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:02.903370 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:02.903981 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:02.910185 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:02.910619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:02.911410 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:02.911895 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:03.044559 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:03.052597 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:03.054298 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:03.055584 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f0a9b85-e3c8-4db6-a1e1-0aa52c036043 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.155943 Jul 21 08:31:03.055982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 37/76] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:02 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:03.196577 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9dc11692-855b-43be-be82-58277b0f4d67 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:03.197194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9dc11692-855b-43be-be82-58277b0f4d67 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:03.203601 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dc11692-855b-43be-be82-58277b0f4d67 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:03.204054 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dc11692-855b-43be-be82-58277b0f4d67 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:03.204827 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dc11692-855b-43be-be82-58277b0f4d67 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:03.205265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dc11692-855b-43be-be82-58277b0f4d67 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:03.335432 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9dc11692-855b-43be-be82-58277b0f4d67 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:03.343531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9dc11692-855b-43be-be82-58277b0f4d67 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.150771 Jul 21 08:31:03.344150 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 40/77] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:03 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:03.807498 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ffc8547-e1df-4d33-81f7-314345e3b78f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:03.808099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ffc8547-e1df-4d33-81f7-314345e3b78f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:03.814414 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ffc8547-e1df-4d33-81f7-314345e3b78f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:03.814860 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ffc8547-e1df-4d33-81f7-314345e3b78f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:03.815703 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ffc8547-e1df-4d33-81f7-314345e3b78f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:03.816157 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ffc8547-e1df-4d33-81f7-314345e3b78f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:03.912877 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-1af116fc-07b0-4950-9303-d80ca042a63d req-308d406c-2aef-4fba-bfc2-8427d12cf43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a142cdd4-307c-476e-a178-54914626cda0", "name": "network-vif-plugged", "status": "completed", "tag": "6c401b8c-2f91-49c6-acfe-52333748b0c9"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:03.921111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-1af116fc-07b0-4950-9303-d80ca042a63d req-308d406c-2aef-4fba-bfc2-8427d12cf43f service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:03.921557 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-1af116fc-07b0-4950-9303-d80ca042a63d req-308d406c-2aef-4fba-bfc2-8427d12cf43f service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:03.933111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-1af116fc-07b0-4950-9303-d80ca042a63d req-308d406c-2aef-4fba-bfc2-8427d12cf43f service nova] Creating event network-vif-plugged:6c401b8c-2f91-49c6-acfe-52333748b0c9 for instance a142cdd4-307c-476e-a178-54914626cda0 on hv-cinder-85032 Jul 21 08:31:03.938564 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-1af116fc-07b0-4950-9303-d80ca042a63d req-308d406c-2aef-4fba-bfc2-8427d12cf43f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095027 Jul 21 08:31:03.939498 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 41/78] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:31:03.962060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ffc8547-e1df-4d33-81f7-314345e3b78f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:03.970147 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ffc8547-e1df-4d33-81f7-314345e3b78f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.166479 Jul 21 08:31:03.970729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 38/79] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:03 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:04.073778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:04.074564 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:04.081731 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:04.082271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:04.083354 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:04.083854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:04.261010 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:04.272370 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:04.274186 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:04.275492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e889343e-122f-45ee-8820-d3c1e7afe969 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.206145 Jul 21 08:31:04.276066 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 42/80] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:04 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:04.361049 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-071e897c-fde8-4df0-8658-713aaf5a3542 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:04.362232 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-071e897c-fde8-4df0-8658-713aaf5a3542 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:04.368589 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-071e897c-fde8-4df0-8658-713aaf5a3542 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:04.369074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-071e897c-fde8-4df0-8658-713aaf5a3542 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:04.369845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-071e897c-fde8-4df0-8658-713aaf5a3542 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:04.370280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-071e897c-fde8-4df0-8658-713aaf5a3542 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:04.576785 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-071e897c-fde8-4df0-8658-713aaf5a3542 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:04.607463 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-071e897c-fde8-4df0-8658-713aaf5a3542 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.248400 Jul 21 08:31:04.609319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 39/81] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:04 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:04.987799 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4d782245-55e5-4deb-8ee1-676776bf7cd2 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:04.988465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4d782245-55e5-4deb-8ee1-676776bf7cd2 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:04.994415 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d782245-55e5-4deb-8ee1-676776bf7cd2 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:04.994864 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d782245-55e5-4deb-8ee1-676776bf7cd2 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:04.995657 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d782245-55e5-4deb-8ee1-676776bf7cd2 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:04.996095 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d782245-55e5-4deb-8ee1-676776bf7cd2 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:05.137069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4d782245-55e5-4deb-8ee1-676776bf7cd2 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:05.141059 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:05.145762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4d782245-55e5-4deb-8ee1-676776bf7cd2 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.161848 Jul 21 08:31:05.146323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 43/82] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:04 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:05.293994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:05.294823 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:05.301075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:05.301634 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:05.302524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:05.302988 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:05.443197 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:05.452279 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:05.454117 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:05.455441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-86e5a697-49c1-464a-a455-d278cb2af20b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.165074 Jul 21 08:31:05.456001 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 40/83] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:05 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:05.627854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-443988de-c314-499b-898e-26ee66377014 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:05.628458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-443988de-c314-499b-898e-26ee66377014 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:05.649954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-443988de-c314-499b-898e-26ee66377014 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:05.650403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-443988de-c314-499b-898e-26ee66377014 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:05.655385 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-443988de-c314-499b-898e-26ee66377014 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:05.655385 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-443988de-c314-499b-898e-26ee66377014 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:05.835707 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-443988de-c314-499b-898e-26ee66377014 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:05.845198 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-443988de-c314-499b-898e-26ee66377014 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.221227 Jul 21 08:31:05.846561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 44/84] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:05 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:06.162690 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-069548a9-0719-4147-be82-e770f79bce9a tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:06.163552 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-069548a9-0719-4147-be82-e770f79bce9a tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:06.170875 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-069548a9-0719-4147-be82-e770f79bce9a tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:06.171348 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-069548a9-0719-4147-be82-e770f79bce9a tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:06.172130 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-069548a9-0719-4147-be82-e770f79bce9a tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:06.172565 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-069548a9-0719-4147-be82-e770f79bce9a tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:06.308960 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-069548a9-0719-4147-be82-e770f79bce9a tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:06.312875 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:06.319142 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-069548a9-0719-4147-be82-e770f79bce9a tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.160233 Jul 21 08:31:06.319819 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 41/85] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:06 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:06.473389 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:06.474003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:06.483452 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:06.483998 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:06.484879 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:06.485376 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:06.621732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:06.631224 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:06.632800 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:06.633927 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ca4d969c-a5c6-4414-a1d1-e0a9e301733c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.164859 Jul 21 08:31:06.634488 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 45/86] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:06 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:06.861935 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa61674b-1309-49a4-8204-2b3c0f3959e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:06.862540 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa61674b-1309-49a4-8204-2b3c0f3959e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:06.869007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa61674b-1309-49a4-8204-2b3c0f3959e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:06.869486 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa61674b-1309-49a4-8204-2b3c0f3959e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:06.870251 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa61674b-1309-49a4-8204-2b3c0f3959e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:06.871048 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa61674b-1309-49a4-8204-2b3c0f3959e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:07.002988 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa61674b-1309-49a4-8204-2b3c0f3959e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:07.011136 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa61674b-1309-49a4-8204-2b3c0f3959e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.152945 Jul 21 08:31:07.011882 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 42/87] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:06 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:07.335863 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d6c50388-e197-469f-af8d-3d0618d7ef51 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:07.336589 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d6c50388-e197-469f-af8d-3d0618d7ef51 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:07.342790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6c50388-e197-469f-af8d-3d0618d7ef51 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:07.343303 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6c50388-e197-469f-af8d-3d0618d7ef51 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:07.344153 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6c50388-e197-469f-af8d-3d0618d7ef51 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:07.344585 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6c50388-e197-469f-af8d-3d0618d7ef51 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:07.509277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6c50388-e197-469f-af8d-3d0618d7ef51 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:07.517199 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d6c50388-e197-469f-af8d-3d0618d7ef51 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.185035 Jul 21 08:31:07.517783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 46/88] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:07 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:07.652333 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:07.653208 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:07.659567 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:07.660012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:07.660769 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:07.661200 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:07.814469 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:07.826019 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:07.828145 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:07.829835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-853f4526-0e98-4578-9ca8-e080fad5026f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.181101 Jul 21 08:31:07.831165 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 43/89] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:07 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:31:08.029772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6327aa5b-8d4e-4567-96ef-76ba71282719 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:08.030772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6327aa5b-8d4e-4567-96ef-76ba71282719 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:08.039792 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6327aa5b-8d4e-4567-96ef-76ba71282719 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:08.040516 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6327aa5b-8d4e-4567-96ef-76ba71282719 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:08.041465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6327aa5b-8d4e-4567-96ef-76ba71282719 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:08.042110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6327aa5b-8d4e-4567-96ef-76ba71282719 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:08.282024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6327aa5b-8d4e-4567-96ef-76ba71282719 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:08.293073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6327aa5b-8d4e-4567-96ef-76ba71282719 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.267807 Jul 21 08:31:08.293748 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 47/90] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:08 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:08.535016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-00fd8702-78f2-439e-b90a-aee133a2d156 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:08.535675 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-00fd8702-78f2-439e-b90a-aee133a2d156 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:08.541470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00fd8702-78f2-439e-b90a-aee133a2d156 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:08.541920 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00fd8702-78f2-439e-b90a-aee133a2d156 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:08.542654 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00fd8702-78f2-439e-b90a-aee133a2d156 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:08.543074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00fd8702-78f2-439e-b90a-aee133a2d156 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:08.740741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-00fd8702-78f2-439e-b90a-aee133a2d156 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:08.749749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-00fd8702-78f2-439e-b90a-aee133a2d156 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.218528 Jul 21 08:31:08.750338 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 44/91] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:08 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:08.848383 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:08.848997 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:08.855398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:08.856099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:08.857307 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:08.857938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:09.062382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:09.070698 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:09.072249 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:09.073373 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-17cbb362-36aa-4d0c-9d10-52a9b1f36118 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.228955 Jul 21 08:31:09.074125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 48/92] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:08 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:09.311788 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eeffe3b9-9a98-4242-b621-bdefbf6eedc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:09.312397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eeffe3b9-9a98-4242-b621-bdefbf6eedc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:09.321326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eeffe3b9-9a98-4242-b621-bdefbf6eedc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:09.321857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eeffe3b9-9a98-4242-b621-bdefbf6eedc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:09.322714 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eeffe3b9-9a98-4242-b621-bdefbf6eedc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:09.323219 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eeffe3b9-9a98-4242-b621-bdefbf6eedc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:09.460876 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eeffe3b9-9a98-4242-b621-bdefbf6eedc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:09.468478 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eeffe3b9-9a98-4242-b621-bdefbf6eedc2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.161796 Jul 21 08:31:09.468981 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 45/93] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:09 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:09.768047 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-151dbd3e-f156-415f-9a37-6d278ed24c54 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:09.768727 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-151dbd3e-f156-415f-9a37-6d278ed24c54 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:09.774898 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-151dbd3e-f156-415f-9a37-6d278ed24c54 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:09.775405 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-151dbd3e-f156-415f-9a37-6d278ed24c54 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:09.776178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-151dbd3e-f156-415f-9a37-6d278ed24c54 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:09.776673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-151dbd3e-f156-415f-9a37-6d278ed24c54 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:09.910766 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-151dbd3e-f156-415f-9a37-6d278ed24c54 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:09.919068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-151dbd3e-f156-415f-9a37-6d278ed24c54 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.154586 Jul 21 08:31:09.919663 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 49/94] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:09 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:10.092521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:10.093062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:10.099047 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:10.099526 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:10.100283 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:10.100715 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:10.233234 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:10.243080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:10.244586 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:10.245711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-780aafbe-a67c-4acd-8453-b11111cb2528 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.157166 Jul 21 08:31:10.246378 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 46/95] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:10 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:10.484936 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a35cd045-e8f1-4b8e-825f-383989024dd3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:10.485559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a35cd045-e8f1-4b8e-825f-383989024dd3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:10.492207 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a35cd045-e8f1-4b8e-825f-383989024dd3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:10.492844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a35cd045-e8f1-4b8e-825f-383989024dd3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:10.493733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a35cd045-e8f1-4b8e-825f-383989024dd3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:10.494268 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a35cd045-e8f1-4b8e-825f-383989024dd3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:10.625651 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a35cd045-e8f1-4b8e-825f-383989024dd3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:10.633267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a35cd045-e8f1-4b8e-825f-383989024dd3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.152733 Jul 21 08:31:10.633845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 50/96] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:10 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:10.936359 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1d2b6f3-cabd-4130-98f1-01511f62d4af tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:10.936970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1d2b6f3-cabd-4130-98f1-01511f62d4af tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:10.942996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1d2b6f3-cabd-4130-98f1-01511f62d4af tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:10.943378 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1d2b6f3-cabd-4130-98f1-01511f62d4af tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:10.944142 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1d2b6f3-cabd-4130-98f1-01511f62d4af tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:10.944801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1d2b6f3-cabd-4130-98f1-01511f62d4af tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:11.107005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1d2b6f3-cabd-4130-98f1-01511f62d4af tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:11.130134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1d2b6f3-cabd-4130-98f1-01511f62d4af tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.198030 Jul 21 08:31:11.130719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 47/97] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:10 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:11.265444 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:11.266054 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:11.271845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:11.272285 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:11.273038 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:11.273465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:11.618591 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:11.628181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:11.629953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:11.631072 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-42639fc5-27f5-46bd-b71d-4c73278d489f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.370198 Jul 21 08:31:11.631673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 51/98] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:11 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:11.657361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60f0c251-5a93-4500-8892-6492d6a8b7ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:11.658173 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60f0c251-5a93-4500-8892-6492d6a8b7ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:11.665411 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60f0c251-5a93-4500-8892-6492d6a8b7ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:11.666038 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60f0c251-5a93-4500-8892-6492d6a8b7ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:11.667070 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60f0c251-5a93-4500-8892-6492d6a8b7ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:11.667692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60f0c251-5a93-4500-8892-6492d6a8b7ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:11.807845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60f0c251-5a93-4500-8892-6492d6a8b7ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:11.815693 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60f0c251-5a93-4500-8892-6492d6a8b7ce tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.165536 Jul 21 08:31:11.816337 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 48/99] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:11 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:11.933142 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1522440844", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "networks": [{"uuid": "3d7d50f4-aa56-4ed9-ae9c-589f9803dd64"}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:11.990604 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] validate_networks() for [('3d7d50f4-aa56-4ed9-ae9c-589f9803dd64', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:31:12.149358 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cecaac24-a508-4828-a30f-9a5f66d836a8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:12.150136 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cecaac24-a508-4828-a30f-9a5f66d836a8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:12.156247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cecaac24-a508-4828-a30f-9a5f66d836a8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:12.156663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cecaac24-a508-4828-a30f-9a5f66d836a8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:12.157409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cecaac24-a508-4828-a30f-9a5f66d836a8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:12.157832 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cecaac24-a508-4828-a30f-9a5f66d836a8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:12.290373 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cecaac24-a508-4828-a30f-9a5f66d836a8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:12.298330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cecaac24-a508-4828-a30f-9a5f66d836a8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.154209 Jul 21 08:31:12.298969 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 49/100] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:12 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:12.350798 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:31:12.351345 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:31:12.351698 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:31:12.352098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:31:12.352501 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:31:12.362210 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:12.362655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:12.363522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:12.363900 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:12.385292 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Getting quotas for project 419b6c6707544364b82f3f6fb5030032. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:31:12.389506 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Getting quotas for user 1f914243baf846f5b43a929332bcef6e and project 419b6c6707544364b82f3f6fb5030032. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:31:12.400732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:31:12.403505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:31:12.456017 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1f7b1dd3-4edc-464d-b9f2-79b07cb13ef3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526770 Jul 21 08:31:12.456656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 52/101] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:31:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:31:12.467440 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-206b76f8-96c6-40b7-9586-36a720dcba17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:12.467771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-206b76f8-96c6-40b7-9586-36a720dcba17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:12.554692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-206b76f8-96c6-40b7-9586-36a720dcba17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:12.565293 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-206b76f8-96c6-40b7-9586-36a720dcba17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1219 microversion: 2.1 time: 0.102292 Jul 21 08:31:12.566672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 50/102] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:12 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:12.649943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:12.650775 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:12.666340 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:12.667929 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:12.669946 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:12.670900 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:12.835152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-87e873a6-6f39-4316-8567-85f563ce87f7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:12.836146 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-87e873a6-6f39-4316-8567-85f563ce87f7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:12.844097 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87e873a6-6f39-4316-8567-85f563ce87f7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:12.845750 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87e873a6-6f39-4316-8567-85f563ce87f7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:12.847037 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87e873a6-6f39-4316-8567-85f563ce87f7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:12.847710 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87e873a6-6f39-4316-8567-85f563ce87f7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:12.940396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:12.952469 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:12.956570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:12.958384 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b6ef3a48-7331-4d1b-aaf2-93532f38b3c2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.312580 Jul 21 08:31:12.974933 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 53/103] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:12 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:13.155586 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-87e873a6-6f39-4316-8567-85f563ce87f7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:13.200387 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-87e873a6-6f39-4316-8567-85f563ce87f7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.364025 Jul 21 08:31:13.200684 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-6030e9de-e957-4dbe-bf69-a2877adc6abf req-dae31f75-c9d6-45e4-aeef-f3e74616f137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a", "name": "network-vif-plugged", "status": "completed", "tag": "dc3ec772-1aa6-40c5-a783-9c70e0e921dd"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:13.202030 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 51/104] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:12 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:13.212372 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-6030e9de-e957-4dbe-bf69-a2877adc6abf req-dae31f75-c9d6-45e4-aeef-f3e74616f137 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:13.212811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-6030e9de-e957-4dbe-bf69-a2877adc6abf req-dae31f75-c9d6-45e4-aeef-f3e74616f137 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:13.229333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-6030e9de-e957-4dbe-bf69-a2877adc6abf req-dae31f75-c9d6-45e4-aeef-f3e74616f137 service nova] Creating event network-vif-plugged:dc3ec772-1aa6-40c5-a783-9c70e0e921dd for instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a on hv-cinder-85032 Jul 21 08:31:13.235655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-6030e9de-e957-4dbe-bf69-a2877adc6abf req-dae31f75-c9d6-45e4-aeef-f3e74616f137 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038532 Jul 21 08:31:13.237110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 54/105] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:31:13.316138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-082efa16-3945-47c9-a42d-b17fb3141ffb tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:13.316759 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-082efa16-3945-47c9-a42d-b17fb3141ffb tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:13.331935 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-082efa16-3945-47c9-a42d-b17fb3141ffb tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:13.332391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-082efa16-3945-47c9-a42d-b17fb3141ffb tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:13.333327 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-082efa16-3945-47c9-a42d-b17fb3141ffb tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:13.335442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-082efa16-3945-47c9-a42d-b17fb3141ffb tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:13.584562 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-97b0785c-7ade-42f3-984b-b040952ed898 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:13.585540 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-97b0785c-7ade-42f3-984b-b040952ed898 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:13.591628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-082efa16-3945-47c9-a42d-b17fb3141ffb tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:13.593361 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97b0785c-7ade-42f3-984b-b040952ed898 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:13.593926 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97b0785c-7ade-42f3-984b-b040952ed898 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:13.594716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97b0785c-7ade-42f3-984b-b040952ed898 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:13.595209 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97b0785c-7ade-42f3-984b-b040952ed898 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:13.600909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-082efa16-3945-47c9-a42d-b17fb3141ffb tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.289243 Jul 21 08:31:13.601910 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 52/106] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:13 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:13.678641 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-97b0785c-7ade-42f3-984b-b040952ed898 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:13.688747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-97b0785c-7ade-42f3-984b-b040952ed898 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1223 microversion: 2.1 time: 0.109346 Jul 21 08:31:13.689429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 55/107] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:13 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:13.979544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:13.980348 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:13.990998 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:13.994696 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:13.994696 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:13.994696 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:14.191013 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:14.209702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:14.212207 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:14.219915 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6ea10e8b-63c2-47db-9c65-f5a425b457f4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:14.220816 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6ea10e8b-63c2-47db-9c65-f5a425b457f4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:14.225060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b1fd0e91-5cd2-40df-bbae-edfe84e2559e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.249285 Jul 21 08:31:14.225659 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 53/108] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:13 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:14.239036 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ea10e8b-63c2-47db-9c65-f5a425b457f4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:14.239369 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ea10e8b-63c2-47db-9c65-f5a425b457f4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:14.240707 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ea10e8b-63c2-47db-9c65-f5a425b457f4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:14.242196 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ea10e8b-63c2-47db-9c65-f5a425b457f4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:14.402388 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6ea10e8b-63c2-47db-9c65-f5a425b457f4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:14.409897 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6ea10e8b-63c2-47db-9c65-f5a425b457f4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.195738 Jul 21 08:31:14.410473 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 56/109] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:14 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:14.619123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-87538177-e910-499c-b726-6ddb848d74bf tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:14.619784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-87538177-e910-499c-b726-6ddb848d74bf tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:14.626578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87538177-e910-499c-b726-6ddb848d74bf tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:14.627069 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87538177-e910-499c-b726-6ddb848d74bf tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:14.627907 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87538177-e910-499c-b726-6ddb848d74bf tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:14.628405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87538177-e910-499c-b726-6ddb848d74bf tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:14.706185 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ceb42f07-f192-41a3-809c-bd229524efad tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:14.706911 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ceb42f07-f192-41a3-809c-bd229524efad tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:14.713851 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ceb42f07-f192-41a3-809c-bd229524efad tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:14.714968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ceb42f07-f192-41a3-809c-bd229524efad tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:14.716613 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ceb42f07-f192-41a3-809c-bd229524efad tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:14.717249 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ceb42f07-f192-41a3-809c-bd229524efad tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:14.789092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-87538177-e910-499c-b726-6ddb848d74bf tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:14.797365 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-87538177-e910-499c-b726-6ddb848d74bf tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.182663 Jul 21 08:31:14.798251 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 54/110] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:14 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:14.815467 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ceb42f07-f192-41a3-809c-bd229524efad tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:14.822953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ceb42f07-f192-41a3-809c-bd229524efad tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1223 microversion: 2.1 time: 0.120405 Jul 21 08:31:14.823674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 57/111] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:14 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:15.244844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:15.245325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:15.252307 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.252798 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.253733 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.254604 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.296740 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-f25621cc-1e1d-4711-a1ce-6b475047d0aa req-2a378604-66e9-4ede-acf2-e168ddb05bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284babfb-5c35-4312-ad28-7af7026b4f51", "name": "network-vif-plugged", "status": "completed", "tag": "13bfbdd0-2bcd-4e96-9be4-7eea28463ac1"}, {"server_uuid": "2248844f-40e4-41cb-aa40-cdd614390793", "name": "network-vif-plugged", "status": "completed", "tag": "411d3f73-9846-4340-8e3f-ffc3a9ff1fa5"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:15.300709 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:15.317191 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f25621cc-1e1d-4711-a1ce-6b475047d0aa req-2a378604-66e9-4ede-acf2-e168ddb05bd2 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.319857 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f25621cc-1e1d-4711-a1ce-6b475047d0aa req-2a378604-66e9-4ede-acf2-e168ddb05bd2 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.345163 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-f25621cc-1e1d-4711-a1ce-6b475047d0aa req-2a378604-66e9-4ede-acf2-e168ddb05bd2 service nova] Creating event network-vif-plugged:13bfbdd0-2bcd-4e96-9be4-7eea28463ac1 for instance 284babfb-5c35-4312-ad28-7af7026b4f51 on hv-cinder-85032 Jul 21 08:31:15.345944 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-f25621cc-1e1d-4711-a1ce-6b475047d0aa req-2a378604-66e9-4ede-acf2-e168ddb05bd2 service nova] Creating event network-vif-plugged:411d3f73-9846-4340-8e3f-ffc3a9ff1fa5 for instance 2248844f-40e4-41cb-aa40-cdd614390793 on hv-cinder-85032 Jul 21 08:31:15.365299 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-f25621cc-1e1d-4711-a1ce-6b475047d0aa req-2a378604-66e9-4ede-acf2-e168ddb05bd2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071452 Jul 21 08:31:15.370702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 58/112] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:31:15.427361 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0763a651-88d9-40f2-9b94-0b672359b6b0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:15.429367 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0763a651-88d9-40f2-9b94-0b672359b6b0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:15.439704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0763a651-88d9-40f2-9b94-0b672359b6b0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.442450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0763a651-88d9-40f2-9b94-0b672359b6b0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.443511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0763a651-88d9-40f2-9b94-0b672359b6b0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.444506 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0763a651-88d9-40f2-9b94-0b672359b6b0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.453075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:15.461848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:15.463613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:15.464806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-768f710d-ddf9-495d-a3e4-a308df374676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.224864 Jul 21 08:31:15.465663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 55/113] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:15 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:15.641806 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0763a651-88d9-40f2-9b94-0b672359b6b0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:15.652564 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0763a651-88d9-40f2-9b94-0b672359b6b0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.229431 Jul 21 08:31:15.667821 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 59/114] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:15 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:15.814743 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-815c413d-148e-4881-8fd9-01412137858f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:15.815238 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-815c413d-148e-4881-8fd9-01412137858f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:15.822452 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-815c413d-148e-4881-8fd9-01412137858f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.823090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-815c413d-148e-4881-8fd9-01412137858f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.823919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-815c413d-148e-4881-8fd9-01412137858f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.824627 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-815c413d-148e-4881-8fd9-01412137858f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.841171 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-57860bb7-aece-4670-b4c0-a89a9b208113 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:15.842092 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-57860bb7-aece-4670-b4c0-a89a9b208113 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:15.850332 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57860bb7-aece-4670-b4c0-a89a9b208113 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.851635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57860bb7-aece-4670-b4c0-a89a9b208113 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.852975 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57860bb7-aece-4670-b4c0-a89a9b208113 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:15.853608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57860bb7-aece-4670-b4c0-a89a9b208113 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:15.921088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57860bb7-aece-4670-b4c0-a89a9b208113 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:15.929582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-57860bb7-aece-4670-b4c0-a89a9b208113 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1223 microversion: 2.1 time: 0.093035 Jul 21 08:31:15.939914 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 60/115] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:15 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:16.014245 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-815c413d-148e-4881-8fd9-01412137858f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:16.022864 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-815c413d-148e-4881-8fd9-01412137858f tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.211958 Jul 21 08:31:16.023789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 56/116] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:15 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:16.483172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:16.483815 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:16.493256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:16.493984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:16.495016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:16.495869 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:16.675510 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad2b2516-54bd-4f56-bdf6-a03943ad4857 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:16.676124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad2b2516-54bd-4f56-bdf6-a03943ad4857 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:16.684196 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:16.698333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:16.703209 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad2b2516-54bd-4f56-bdf6-a03943ad4857 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:16.705234 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad2b2516-54bd-4f56-bdf6-a03943ad4857 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:16.706123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad2b2516-54bd-4f56-bdf6-a03943ad4857 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:16.706747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:16.708054 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-88bda8cf-c3e1-463e-b74e-2c1974c0e710 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.229264 Jul 21 08:31:16.708552 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad2b2516-54bd-4f56-bdf6-a03943ad4857 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:16.714755 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 61/117] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:16 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:16.948043 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-59efe16c-1e18-47a2-b4a5-42b523cb88d3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:16.948675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-59efe16c-1e18-47a2-b4a5-42b523cb88d3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:16.955764 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59efe16c-1e18-47a2-b4a5-42b523cb88d3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:16.956260 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59efe16c-1e18-47a2-b4a5-42b523cb88d3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:16.957127 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59efe16c-1e18-47a2-b4a5-42b523cb88d3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:16.957541 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59efe16c-1e18-47a2-b4a5-42b523cb88d3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:16.998368 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad2b2516-54bd-4f56-bdf6-a03943ad4857 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:16.998667 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:17.009100 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad2b2516-54bd-4f56-bdf6-a03943ad4857 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.337847 Jul 21 08:31:17.010574 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 57/118] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:16 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:17.042393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d522751e-7236-4128-8cfc-e0620bfc7c20 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:17.043655 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d522751e-7236-4128-8cfc-e0620bfc7c20 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:17.050175 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d522751e-7236-4128-8cfc-e0620bfc7c20 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:17.051050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d522751e-7236-4128-8cfc-e0620bfc7c20 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:17.061992 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d522751e-7236-4128-8cfc-e0620bfc7c20 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:17.061992 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d522751e-7236-4128-8cfc-e0620bfc7c20 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:17.077353 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-59efe16c-1e18-47a2-b4a5-42b523cb88d3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:17.085644 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-59efe16c-1e18-47a2-b4a5-42b523cb88d3 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1215 microversion: 2.1 time: 0.141476 Jul 21 08:31:17.086224 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 62/119] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:16 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:17.199909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d522751e-7236-4128-8cfc-e0620bfc7c20 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:17.208046 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d522751e-7236-4128-8cfc-e0620bfc7c20 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.171298 Jul 21 08:31:17.208943 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 58/120] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:17 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:17.735962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:17.738197 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:17.747181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:17.748523 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:17.750144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:17.751231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:17.915345 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:17.925030 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:17.927159 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:17.928363 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9bcf8bef-4328-4e43-8ee5-dcd060e2ee5f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.199810 Jul 21 08:31:17.928997 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 63/121] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:17 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:18.031404 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05cce8ea-18b4-447b-bcbc-a9889824e9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:18.033126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05cce8ea-18b4-447b-bcbc-a9889824e9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:18.042519 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05cce8ea-18b4-447b-bcbc-a9889824e9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:18.043369 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05cce8ea-18b4-447b-bcbc-a9889824e9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:18.044613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05cce8ea-18b4-447b-bcbc-a9889824e9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:18.045391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05cce8ea-18b4-447b-bcbc-a9889824e9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:18.069121 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:18.104491 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b8f0f407-9a79-47e8-9357-e7aa6d9afa51 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:18.105263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b8f0f407-9a79-47e8-9357-e7aa6d9afa51 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:18.116647 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8f0f407-9a79-47e8-9357-e7aa6d9afa51 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:18.117322 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8f0f407-9a79-47e8-9357-e7aa6d9afa51 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:18.118237 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8f0f407-9a79-47e8-9357-e7aa6d9afa51 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:18.118860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8f0f407-9a79-47e8-9357-e7aa6d9afa51 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:18.210107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b8f0f407-9a79-47e8-9357-e7aa6d9afa51 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:18.221343 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b8f0f407-9a79-47e8-9357-e7aa6d9afa51 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1271 microversion: 2.1 time: 0.121890 Jul 21 08:31:18.222345 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 64/122] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:18 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:18.227312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0aad3f24-303f-4636-97d0-4ff2149d8710 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:18.228107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0aad3f24-303f-4636-97d0-4ff2149d8710 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:18.235700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0aad3f24-303f-4636-97d0-4ff2149d8710 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:18.236568 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0aad3f24-303f-4636-97d0-4ff2149d8710 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:18.237941 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0aad3f24-303f-4636-97d0-4ff2149d8710 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:18.238577 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0aad3f24-303f-4636-97d0-4ff2149d8710 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:18.287806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05cce8ea-18b4-447b-bcbc-a9889824e9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:18.313953 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05cce8ea-18b4-447b-bcbc-a9889824e9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.290815 Jul 21 08:31:18.314548 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 59/123] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:18 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:18.455575 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0aad3f24-303f-4636-97d0-4ff2149d8710 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:18.463067 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0aad3f24-303f-4636-97d0-4ff2149d8710 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.239693 Jul 21 08:31:18.464806 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 65/124] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:18 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:18.946430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:18.947301 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:18.956374 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:18.957216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:18.958381 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:18.958972 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:19.166576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:19.179657 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:19.181299 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:19.184790 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-195e4401-2d29-435d-907c-ed807eed273f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1406 microversion: 2.20 time: 0.239880 Jul 21 08:31:19.185475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 60/125] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:18 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:19.242172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-33fadac6-113b-45bd-8911-2875f32ef84b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:19.243286 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-33fadac6-113b-45bd-8911-2875f32ef84b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:19.252751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33fadac6-113b-45bd-8911-2875f32ef84b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:19.253544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33fadac6-113b-45bd-8911-2875f32ef84b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:19.254776 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33fadac6-113b-45bd-8911-2875f32ef84b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:19.255415 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33fadac6-113b-45bd-8911-2875f32ef84b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:19.330412 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2cfeb3bb-8655-44fc-908b-dd9ac4e09cad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:19.330928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2cfeb3bb-8655-44fc-908b-dd9ac4e09cad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:19.340799 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=82 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:19.342308 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cfeb3bb-8655-44fc-908b-dd9ac4e09cad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:19.342957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cfeb3bb-8655-44fc-908b-dd9ac4e09cad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:19.343756 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cfeb3bb-8655-44fc-908b-dd9ac4e09cad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:19.344180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cfeb3bb-8655-44fc-908b-dd9ac4e09cad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:19.344949 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-33fadac6-113b-45bd-8911-2875f32ef84b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:19.358048 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-33fadac6-113b-45bd-8911-2875f32ef84b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1279 microversion: 2.1 time: 0.122119 Jul 21 08:31:19.359482 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 66/126] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:19 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:19.481744 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-53d26200-6c68-4a13-8e17-615bea1604ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:19.482428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-53d26200-6c68-4a13-8e17-615bea1604ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:19.493502 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53d26200-6c68-4a13-8e17-615bea1604ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:19.494117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53d26200-6c68-4a13-8e17-615bea1604ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:19.495146 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53d26200-6c68-4a13-8e17-615bea1604ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:19.497045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53d26200-6c68-4a13-8e17-615bea1604ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:19.558833 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2cfeb3bb-8655-44fc-908b-dd9ac4e09cad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:19.568012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2cfeb3bb-8655-44fc-908b-dd9ac4e09cad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1322 microversion: 2.1 time: 0.241659 Jul 21 08:31:19.568766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 61/127] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:19 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:19.848570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-53d26200-6c68-4a13-8e17-615bea1604ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:19.858175 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-53d26200-6c68-4a13-8e17-615bea1604ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1315 microversion: 2.1 time: 0.380649 Jul 21 08:31:19.858762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 67/128] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:19 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:20.206205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:20.208296 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:20.217042 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.217634 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.218877 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.219308 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.380090 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-45b5ca12-43ec-47ef-9418-922658696480 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:20.380871 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-45b5ca12-43ec-47ef-9418-922658696480 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:20.388910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-45b5ca12-43ec-47ef-9418-922658696480 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.389367 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-45b5ca12-43ec-47ef-9418-922658696480 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.390911 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-45b5ca12-43ec-47ef-9418-922658696480 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.391606 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-45b5ca12-43ec-47ef-9418-922658696480 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.400740 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:20.411085 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:20.415692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:20.417739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84b394e7-e5a3-4652-b81b-12bef8922a0c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1598 microversion: 2.20 time: 0.216632 Jul 21 08:31:20.418855 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 62/129] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:31:20 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1598 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:31:20.436311 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f79b05c7-9a60-44e6-b083-55fdadf2cc5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:20.436806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f79b05c7-9a60-44e6-b083-55fdadf2cc5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:20.447364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f79b05c7-9a60-44e6-b083-55fdadf2cc5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.452477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f79b05c7-9a60-44e6-b083-55fdadf2cc5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.453409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f79b05c7-9a60-44e6-b083-55fdadf2cc5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.453858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f79b05c7-9a60-44e6-b083-55fdadf2cc5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.483431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-45b5ca12-43ec-47ef-9418-922658696480 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:20.494360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-45b5ca12-43ec-47ef-9418-922658696480 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1277 microversion: 2.1 time: 0.121942 Jul 21 08:31:20.495415 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 68/130] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:20 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:20.589137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-04435d3b-7a3c-4e01-a2bc-aa62daf02f87 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:20.591460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-04435d3b-7a3c-4e01-a2bc-aa62daf02f87 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:20.601852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-04435d3b-7a3c-4e01-a2bc-aa62daf02f87 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.602900 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-04435d3b-7a3c-4e01-a2bc-aa62daf02f87 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.603990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-04435d3b-7a3c-4e01-a2bc-aa62daf02f87 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.604508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-04435d3b-7a3c-4e01-a2bc-aa62daf02f87 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.623093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f79b05c7-9a60-44e6-b083-55fdadf2cc5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.190650 Jul 21 08:31:20.628095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 63/131] 10.222.0.47 () {60 vars in 1315 bytes} [Thu Jul 21 08:31:20 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:31:20.886131 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d76321c-3fce-43aa-bd7b-8b3d499ec266 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:20.887603 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d76321c-3fce-43aa-bd7b-8b3d499ec266 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:20.904959 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d76321c-3fce-43aa-bd7b-8b3d499ec266 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.906486 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d76321c-3fce-43aa-bd7b-8b3d499ec266 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:20.909311 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d76321c-3fce-43aa-bd7b-8b3d499ec266 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:20.911466 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d76321c-3fce-43aa-bd7b-8b3d499ec266 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:21.058668 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-04435d3b-7a3c-4e01-a2bc-aa62daf02f87 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:21.078651 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-04435d3b-7a3c-4e01-a2bc-aa62daf02f87 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1517 microversion: 2.1 time: 0.493360 Jul 21 08:31:21.079738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 69/132] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:20 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1517 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:21.097047 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-394ee385-15aa-4e9c-9422-a7ff2fa294c0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:21.098276 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-394ee385-15aa-4e9c-9422-a7ff2fa294c0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:21.111812 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-394ee385-15aa-4e9c-9422-a7ff2fa294c0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:21.112253 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-394ee385-15aa-4e9c-9422-a7ff2fa294c0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:21.113933 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-394ee385-15aa-4e9c-9422-a7ff2fa294c0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:21.120409 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-394ee385-15aa-4e9c-9422-a7ff2fa294c0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:21.214701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d76321c-3fce-43aa-bd7b-8b3d499ec266 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:21.225772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d76321c-3fce-43aa-bd7b-8b3d499ec266 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1502 microversion: 2.1 time: 0.346621 Jul 21 08:31:21.228104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 64/133] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:20 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1502 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:21.266668 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-394ee385-15aa-4e9c-9422-a7ff2fa294c0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lazy-loading 'flavor' on Instance uuid 284babfb-5c35-4312-ad28-7af7026b4f51 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:31:21.514256 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-23752442-9d18-410e-919f-76b3b7b24f0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:21.514918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-23752442-9d18-410e-919f-76b3b7b24f0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:21.528725 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23752442-9d18-410e-919f-76b3b7b24f0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:21.529345 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23752442-9d18-410e-919f-76b3b7b24f0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:21.532354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23752442-9d18-410e-919f-76b3b7b24f0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:21.536305 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23752442-9d18-410e-919f-76b3b7b24f0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:21.560660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-394ee385-15aa-4e9c-9422-a7ff2fa294c0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51/action" status: 200 len: 32 microversion: 2.1 time: 0.465163 Jul 21 08:31:21.564011 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 70/134] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:31:21 2022] POST /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51/action => generated 32 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 08:31:21.577508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-455e311c-564e-41ed-8f51-d1eb6d5e17ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:21.578206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-455e311c-564e-41ed-8f51-d1eb6d5e17ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:21.603868 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-455e311c-564e-41ed-8f51-d1eb6d5e17ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:21.604319 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-455e311c-564e-41ed-8f51-d1eb6d5e17ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:21.605240 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-455e311c-564e-41ed-8f51-d1eb6d5e17ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:21.605697 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-455e311c-564e-41ed-8f51-d1eb6d5e17ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:21.700573 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23752442-9d18-410e-919f-76b3b7b24f0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:21.713123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-23752442-9d18-410e-919f-76b3b7b24f0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1277 microversion: 2.1 time: 0.201009 Jul 21 08:31:21.718962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 65/135] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:21 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:22.350946 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-455e311c-564e-41ed-8f51-d1eb6d5e17ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:22.360353 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-455e311c-564e-41ed-8f51-d1eb6d5e17ad tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.787772 Jul 21 08:31:22.372149 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 71/136] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:21 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:22.740767 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-511319b1-4f24-4ef3-aa41-8ac21fe388ce tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:22.741265 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-511319b1-4f24-4ef3-aa41-8ac21fe388ce tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:22.752698 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:22.758014 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-511319b1-4f24-4ef3-aa41-8ac21fe388ce tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:22.761583 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-511319b1-4f24-4ef3-aa41-8ac21fe388ce tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:22.764809 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-511319b1-4f24-4ef3-aa41-8ac21fe388ce tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:22.766926 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-511319b1-4f24-4ef3-aa41-8ac21fe388ce tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:22.903229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-511319b1-4f24-4ef3-aa41-8ac21fe388ce tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:22.917194 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-511319b1-4f24-4ef3-aa41-8ac21fe388ce tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1277 microversion: 2.1 time: 0.184921 Jul 21 08:31:22.917789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 66/137] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:22 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:22.949170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-75019e5d-b22a-49e1-bfa8-09cf0b3fef13 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "652655dc-4279-4f06-87f6-42486896a40b"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:22.951677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-75019e5d-b22a-49e1-bfa8-09cf0b3fef13 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:22.957802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:22.958739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:22.961055 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75019e5d-b22a-49e1-bfa8-09cf0b3fef13 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:22.961702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75019e5d-b22a-49e1-bfa8-09cf0b3fef13 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:22.963126 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75019e5d-b22a-49e1-bfa8-09cf0b3fef13 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:22.963863 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75019e5d-b22a-49e1-bfa8-09cf0b3fef13 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:23.378799 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c565eec5-53ee-435a-88c3-06dc4fd4e006 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:23.380041 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c565eec5-53ee-435a-88c3-06dc4fd4e006 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:23.397068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c565eec5-53ee-435a-88c3-06dc4fd4e006 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:23.399754 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c565eec5-53ee-435a-88c3-06dc4fd4e006 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:23.401677 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c565eec5-53ee-435a-88c3-06dc4fd4e006 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:23.403238 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c565eec5-53ee-435a-88c3-06dc4fd4e006 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:23.601300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-75019e5d-b22a-49e1-bfa8-09cf0b3fef13 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "POST /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656838 Jul 21 08:31:23.603765 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 72/138] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:31:22 2022] POST /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:31:23.680882 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c565eec5-53ee-435a-88c3-06dc4fd4e006 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:23.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c565eec5-53ee-435a-88c3-06dc4fd4e006 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.317973 Jul 21 08:31:23.692273 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 67/139] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:23 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:23.936459 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-149dc4ea-3cd4-4ac4-9a73-a4eef3ceffdd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:23.937530 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-149dc4ea-3cd4-4ac4-9a73-a4eef3ceffdd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:23.964572 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-149dc4ea-3cd4-4ac4-9a73-a4eef3ceffdd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:23.966717 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-149dc4ea-3cd4-4ac4-9a73-a4eef3ceffdd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:23.969840 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-149dc4ea-3cd4-4ac4-9a73-a4eef3ceffdd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:23.971343 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-149dc4ea-3cd4-4ac4-9a73-a4eef3ceffdd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:24.468864 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-eb981b76-6e4b-48d9-8a33-66585dbea73c req-61057b7b-2efe-42b4-86ae-1a361c69519e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a", "tag": "dc3ec772-1aa6-40c5-a783-9c70e0e921dd"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:24.493566 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-eb981b76-6e4b-48d9-8a33-66585dbea73c req-61057b7b-2efe-42b4-86ae-1a361c69519e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:24.495577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-eb981b76-6e4b-48d9-8a33-66585dbea73c req-61057b7b-2efe-42b4-86ae-1a361c69519e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:24.526700 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-eb981b76-6e4b-48d9-8a33-66585dbea73c req-61057b7b-2efe-42b4-86ae-1a361c69519e service nova] Creating event network-changed:dc3ec772-1aa6-40c5-a783-9c70e0e921dd for instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a on hv-cinder-85032 Jul 21 08:31:24.539129 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-eb981b76-6e4b-48d9-8a33-66585dbea73c req-61057b7b-2efe-42b4-86ae-1a361c69519e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077712 Jul 21 08:31:24.542291 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 68/140] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 21 08:31:24.665755 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-149dc4ea-3cd4-4ac4-9a73-a4eef3ceffdd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:24.682403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-149dc4ea-3cd4-4ac4-9a73-a4eef3ceffdd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.751429 Jul 21 08:31:24.683460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 73/141] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:23 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:24.710269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0768458d-cfb1-49c8-8c19-221914c98ffd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:24.711542 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0768458d-cfb1-49c8-8c19-221914c98ffd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:24.724820 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0768458d-cfb1-49c8-8c19-221914c98ffd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:24.725458 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0768458d-cfb1-49c8-8c19-221914c98ffd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:24.744422 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0768458d-cfb1-49c8-8c19-221914c98ffd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:24.744422 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0768458d-cfb1-49c8-8c19-221914c98ffd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:25.132027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0768458d-cfb1-49c8-8c19-221914c98ffd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:25.146729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0768458d-cfb1-49c8-8c19-221914c98ffd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.441156 Jul 21 08:31:25.147336 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 69/142] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:24 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:25.707118 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7deb29d4-5288-4ecc-b53a-c061452c9756 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:25.708061 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7deb29d4-5288-4ecc-b53a-c061452c9756 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:25.722648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7deb29d4-5288-4ecc-b53a-c061452c9756 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:25.731841 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7deb29d4-5288-4ecc-b53a-c061452c9756 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:25.732683 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7deb29d4-5288-4ecc-b53a-c061452c9756 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:25.733302 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7deb29d4-5288-4ecc-b53a-c061452c9756 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:26.163539 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-96dd2cd8-a77f-43b2-9788-a4bc95fd83fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:26.164143 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-96dd2cd8-a77f-43b2-9788-a4bc95fd83fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:26.173475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96dd2cd8-a77f-43b2-9788-a4bc95fd83fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:26.173921 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96dd2cd8-a77f-43b2-9788-a4bc95fd83fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:26.174216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7deb29d4-5288-4ecc-b53a-c061452c9756 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:26.174686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96dd2cd8-a77f-43b2-9788-a4bc95fd83fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:26.175111 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96dd2cd8-a77f-43b2-9788-a4bc95fd83fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:26.185422 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7deb29d4-5288-4ecc-b53a-c061452c9756 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.486979 Jul 21 08:31:26.191652 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 74/143] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:25 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:26.497715 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-96dd2cd8-a77f-43b2-9788-a4bc95fd83fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:26.517332 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-96dd2cd8-a77f-43b2-9788-a4bc95fd83fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.347696 Jul 21 08:31:26.518733 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 70/144] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:26 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:26.584567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-77c62654-bc86-46db-a5f1-058833eedcab req-52c53df7-390b-4751-9493-49ead831687e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89", "tag": "65b822e8-8b30-4d16-acb1-6c6fa99efa0c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:26.598160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-77c62654-bc86-46db-a5f1-058833eedcab req-52c53df7-390b-4751-9493-49ead831687e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:26.598628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-77c62654-bc86-46db-a5f1-058833eedcab req-52c53df7-390b-4751-9493-49ead831687e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:26.620476 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-77c62654-bc86-46db-a5f1-058833eedcab req-52c53df7-390b-4751-9493-49ead831687e service nova] Creating event network-changed:65b822e8-8b30-4d16-acb1-6c6fa99efa0c for instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 on hv-cinder-85032 Jul 21 08:31:26.626285 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-77c62654-bc86-46db-a5f1-058833eedcab req-52c53df7-390b-4751-9493-49ead831687e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046319 Jul 21 08:31:26.627433 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 75/145] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:31:27.206997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c354672f-ab42-47ea-842c-a0f8b2bc6346 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:27.207398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c354672f-ab42-47ea-842c-a0f8b2bc6346 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:27.214302 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c354672f-ab42-47ea-842c-a0f8b2bc6346 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:27.214775 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c354672f-ab42-47ea-842c-a0f8b2bc6346 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:27.216170 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c354672f-ab42-47ea-842c-a0f8b2bc6346 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:27.216560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c354672f-ab42-47ea-842c-a0f8b2bc6346 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:27.350182 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c354672f-ab42-47ea-842c-a0f8b2bc6346 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:27.357978 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c354672f-ab42-47ea-842c-a0f8b2bc6346 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.155142 Jul 21 08:31:27.358885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 71/146] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:27 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:27.543630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b57cf814-e2c1-45de-b3d4-83923a5ad665 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:27.543630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b57cf814-e2c1-45de-b3d4-83923a5ad665 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:27.546514 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b57cf814-e2c1-45de-b3d4-83923a5ad665 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:27.547231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b57cf814-e2c1-45de-b3d4-83923a5ad665 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:27.548367 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b57cf814-e2c1-45de-b3d4-83923a5ad665 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:27.548718 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b57cf814-e2c1-45de-b3d4-83923a5ad665 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:27.569649 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:27.707952 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b57cf814-e2c1-45de-b3d4-83923a5ad665 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:27.717109 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b57cf814-e2c1-45de-b3d4-83923a5ad665 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.185243 Jul 21 08:31:27.718455 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 76/147] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:27 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:28.376101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-292386e6-aaf8-47c6-87fa-72641614ac67 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:28.376718 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-292386e6-aaf8-47c6-87fa-72641614ac67 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:28.383114 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-292386e6-aaf8-47c6-87fa-72641614ac67 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:28.383602 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-292386e6-aaf8-47c6-87fa-72641614ac67 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:28.384358 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-292386e6-aaf8-47c6-87fa-72641614ac67 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:28.384818 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-292386e6-aaf8-47c6-87fa-72641614ac67 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:28.526033 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-292386e6-aaf8-47c6-87fa-72641614ac67 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:28.533796 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-292386e6-aaf8-47c6-87fa-72641614ac67 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.161562 Jul 21 08:31:28.534458 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 72/148] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:28 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:28.735623 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1f629b7-aa31-4414-91c7-3617bbcb0000 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:28.736339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a1f629b7-aa31-4414-91c7-3617bbcb0000 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:28.744039 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1f629b7-aa31-4414-91c7-3617bbcb0000 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:28.744607 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1f629b7-aa31-4414-91c7-3617bbcb0000 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:28.745491 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1f629b7-aa31-4414-91c7-3617bbcb0000 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:28.746809 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1f629b7-aa31-4414-91c7-3617bbcb0000 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:28.891587 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a1f629b7-aa31-4414-91c7-3617bbcb0000 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:28.903527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a1f629b7-aa31-4414-91c7-3617bbcb0000 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.172586 Jul 21 08:31:28.904311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 77/149] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:28 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:29.550651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb75bfef-f402-43e6-aed5-34de568562a1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:29.551404 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb75bfef-f402-43e6-aed5-34de568562a1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:29.557988 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb75bfef-f402-43e6-aed5-34de568562a1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:29.558926 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb75bfef-f402-43e6-aed5-34de568562a1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:29.559979 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb75bfef-f402-43e6-aed5-34de568562a1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:29.560172 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb75bfef-f402-43e6-aed5-34de568562a1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:29.704555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb75bfef-f402-43e6-aed5-34de568562a1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:29.712244 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb75bfef-f402-43e6-aed5-34de568562a1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.165396 Jul 21 08:31:29.712890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 73/150] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:29 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:29.921338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c5f7afce-56cd-4194-a5d0-0398b3b38520 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:29.921967 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c5f7afce-56cd-4194-a5d0-0398b3b38520 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:29.928541 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5f7afce-56cd-4194-a5d0-0398b3b38520 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:29.928986 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5f7afce-56cd-4194-a5d0-0398b3b38520 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:29.929747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5f7afce-56cd-4194-a5d0-0398b3b38520 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:29.930171 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5f7afce-56cd-4194-a5d0-0398b3b38520 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:30.106400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c5f7afce-56cd-4194-a5d0-0398b3b38520 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:30.113981 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c5f7afce-56cd-4194-a5d0-0398b3b38520 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.197270 Jul 21 08:31:30.114564 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 78/151] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:29 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:30.729418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-540239db-6d74-4743-9550-ea1d190c18cf tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:30.730025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-540239db-6d74-4743-9550-ea1d190c18cf tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:30.736322 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-540239db-6d74-4743-9550-ea1d190c18cf tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:30.736766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-540239db-6d74-4743-9550-ea1d190c18cf tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:30.737527 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-540239db-6d74-4743-9550-ea1d190c18cf tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:30.737957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-540239db-6d74-4743-9550-ea1d190c18cf tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:30.882362 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-540239db-6d74-4743-9550-ea1d190c18cf tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:30.890738 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-540239db-6d74-4743-9550-ea1d190c18cf tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.165115 Jul 21 08:31:30.891318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 74/152] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:30 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:31.136070 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f2618847-f69e-48b4-9918-aabce5783c2e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:31.137462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f2618847-f69e-48b4-9918-aabce5783c2e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:31.147971 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2618847-f69e-48b4-9918-aabce5783c2e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:31.148580 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2618847-f69e-48b4-9918-aabce5783c2e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:31.149493 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2618847-f69e-48b4-9918-aabce5783c2e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:31.149950 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2618847-f69e-48b4-9918-aabce5783c2e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:31.355505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f2618847-f69e-48b4-9918-aabce5783c2e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:31.363699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f2618847-f69e-48b4-9918-aabce5783c2e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.235959 Jul 21 08:31:31.373656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 79/153] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:31 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:31.908093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-41b3d4e9-de18-460b-94a6-51d3eec6b209 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:31.908870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-41b3d4e9-de18-460b-94a6-51d3eec6b209 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:31.914974 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41b3d4e9-de18-460b-94a6-51d3eec6b209 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:31.915524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41b3d4e9-de18-460b-94a6-51d3eec6b209 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:31.916352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41b3d4e9-de18-460b-94a6-51d3eec6b209 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:31.916774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41b3d4e9-de18-460b-94a6-51d3eec6b209 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:32.063921 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-41b3d4e9-de18-460b-94a6-51d3eec6b209 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:32.072152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-41b3d4e9-de18-460b-94a6-51d3eec6b209 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.168086 Jul 21 08:31:32.082056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 75/154] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:31 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:32.392063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9b92cf0f-3565-4f15-ace7-f71d349c3775 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:32.392063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9b92cf0f-3565-4f15-ace7-f71d349c3775 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:32.398767 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b92cf0f-3565-4f15-ace7-f71d349c3775 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:32.399223 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b92cf0f-3565-4f15-ace7-f71d349c3775 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:32.400063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b92cf0f-3565-4f15-ace7-f71d349c3775 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:32.400505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b92cf0f-3565-4f15-ace7-f71d349c3775 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:32.537931 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b92cf0f-3565-4f15-ace7-f71d349c3775 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:32.545538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9b92cf0f-3565-4f15-ace7-f71d349c3775 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.160610 Jul 21 08:31:32.546111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 80/155] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:32 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:33.089321 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfc29871-63a0-4649-aeea-0d95d11a972f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:33.089959 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfc29871-63a0-4649-aeea-0d95d11a972f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:33.096039 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfc29871-63a0-4649-aeea-0d95d11a972f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:33.096483 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfc29871-63a0-4649-aeea-0d95d11a972f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:33.097243 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfc29871-63a0-4649-aeea-0d95d11a972f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:33.097670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfc29871-63a0-4649-aeea-0d95d11a972f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:33.231500 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfc29871-63a0-4649-aeea-0d95d11a972f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:33.238806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfc29871-63a0-4649-aeea-0d95d11a972f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.153324 Jul 21 08:31:33.239435 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 76/156] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:33 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:33.561984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-62f62941-aae7-4693-97b4-5271b35d760b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:33.562496 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-62f62941-aae7-4693-97b4-5271b35d760b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:33.569101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f62941-aae7-4693-97b4-5271b35d760b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:33.569579 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f62941-aae7-4693-97b4-5271b35d760b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:33.570340 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f62941-aae7-4693-97b4-5271b35d760b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:33.570775 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f62941-aae7-4693-97b4-5271b35d760b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:33.703451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-62f62941-aae7-4693-97b4-5271b35d760b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:33.710816 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-62f62941-aae7-4693-97b4-5271b35d760b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.152771 Jul 21 08:31:33.711392 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 81/157] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:33 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:34.256660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-52b7acd1-65d3-4aa1-91b0-d9768aeb380e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:34.257295 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-52b7acd1-65d3-4aa1-91b0-d9768aeb380e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:34.263825 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-52b7acd1-65d3-4aa1-91b0-d9768aeb380e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:34.264263 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-52b7acd1-65d3-4aa1-91b0-d9768aeb380e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:34.265021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-52b7acd1-65d3-4aa1-91b0-d9768aeb380e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:34.265441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-52b7acd1-65d3-4aa1-91b0-d9768aeb380e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:34.269451 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:34.402430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-52b7acd1-65d3-4aa1-91b0-d9768aeb380e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:34.409937 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-52b7acd1-65d3-4aa1-91b0-d9768aeb380e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.157391 Jul 21 08:31:34.410510 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 77/158] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:34 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:34.728960 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c18f1472-1f31-4bf0-97d5-045773d9df95 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:34.729589 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c18f1472-1f31-4bf0-97d5-045773d9df95 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:34.737314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c18f1472-1f31-4bf0-97d5-045773d9df95 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:34.737767 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c18f1472-1f31-4bf0-97d5-045773d9df95 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:34.738552 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c18f1472-1f31-4bf0-97d5-045773d9df95 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:34.739017 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c18f1472-1f31-4bf0-97d5-045773d9df95 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:34.871711 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c18f1472-1f31-4bf0-97d5-045773d9df95 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:34.879576 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c18f1472-1f31-4bf0-97d5-045773d9df95 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.154700 Jul 21 08:31:34.880204 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 82/159] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:34 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:35.427516 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-047f5af9-a79e-4ebe-9081-b0b7dd814bbd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:35.428031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-047f5af9-a79e-4ebe-9081-b0b7dd814bbd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:35.433895 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-047f5af9-a79e-4ebe-9081-b0b7dd814bbd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:35.434336 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-047f5af9-a79e-4ebe-9081-b0b7dd814bbd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:35.435131 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-047f5af9-a79e-4ebe-9081-b0b7dd814bbd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:35.435599 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-047f5af9-a79e-4ebe-9081-b0b7dd814bbd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:35.595389 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-047f5af9-a79e-4ebe-9081-b0b7dd814bbd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:35.603152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-047f5af9-a79e-4ebe-9081-b0b7dd814bbd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.179440 Jul 21 08:31:35.603954 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 78/160] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:35 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:35.898292 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cc073eca-6b38-4559-b31c-7acb89e9c173 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:35.898908 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cc073eca-6b38-4559-b31c-7acb89e9c173 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:35.905394 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc073eca-6b38-4559-b31c-7acb89e9c173 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:35.905840 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc073eca-6b38-4559-b31c-7acb89e9c173 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:35.906606 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc073eca-6b38-4559-b31c-7acb89e9c173 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:35.907050 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc073eca-6b38-4559-b31c-7acb89e9c173 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:36.033188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc073eca-6b38-4559-b31c-7acb89e9c173 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:36.040658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cc073eca-6b38-4559-b31c-7acb89e9c173 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.146281 Jul 21 08:31:36.041305 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 83/161] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:35 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:36.620310 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a532b652-4056-41f3-b0f7-25e6f745d7ac tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:36.620866 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a532b652-4056-41f3-b0f7-25e6f745d7ac tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:36.626822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a532b652-4056-41f3-b0f7-25e6f745d7ac tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:36.627271 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a532b652-4056-41f3-b0f7-25e6f745d7ac tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:36.628068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a532b652-4056-41f3-b0f7-25e6f745d7ac tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:36.628499 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a532b652-4056-41f3-b0f7-25e6f745d7ac tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:36.788694 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a532b652-4056-41f3-b0f7-25e6f745d7ac tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:36.796083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a532b652-4056-41f3-b0f7-25e6f745d7ac tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.179707 Jul 21 08:31:36.796660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 79/162] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:36 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:36.845535 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-008f1e9a-02c7-4777-9316-fa0843dd41c1 req-12b3b5d2-a9cf-437c-9caf-a515a0125969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89", "name": "network-vif-plugged", "status": "completed", "tag": "65b822e8-8b30-4d16-acb1-6c6fa99efa0c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:36.854892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-008f1e9a-02c7-4777-9316-fa0843dd41c1 req-12b3b5d2-a9cf-437c-9caf-a515a0125969 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:36.855833 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-008f1e9a-02c7-4777-9316-fa0843dd41c1 req-12b3b5d2-a9cf-437c-9caf-a515a0125969 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:36.867143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-008f1e9a-02c7-4777-9316-fa0843dd41c1 req-12b3b5d2-a9cf-437c-9caf-a515a0125969 service nova] Creating event network-vif-plugged:65b822e8-8b30-4d16-acb1-6c6fa99efa0c for instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 on hv-cinder-85032 Jul 21 08:31:36.872244 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-008f1e9a-02c7-4777-9316-fa0843dd41c1 req-12b3b5d2-a9cf-437c-9caf-a515a0125969 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Jul 21 08:31:36.872785 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 84/163] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:31:37.058570 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-90525b05-4c06-40d1-bc14-0d8f9451e920 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:37.059099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-90525b05-4c06-40d1-bc14-0d8f9451e920 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:37.065134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90525b05-4c06-40d1-bc14-0d8f9451e920 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:37.065576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90525b05-4c06-40d1-bc14-0d8f9451e920 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:37.066331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90525b05-4c06-40d1-bc14-0d8f9451e920 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:37.066757 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90525b05-4c06-40d1-bc14-0d8f9451e920 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:37.195039 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-90525b05-4c06-40d1-bc14-0d8f9451e920 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:37.203010 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-90525b05-4c06-40d1-bc14-0d8f9451e920 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.148901 Jul 21 08:31:37.203614 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 80/164] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:37 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:37.814056 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ee76093b-9c81-49b9-b544-31436943137d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:37.814894 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ee76093b-9c81-49b9-b544-31436943137d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:37.821370 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee76093b-9c81-49b9-b544-31436943137d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:37.821816 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee76093b-9c81-49b9-b544-31436943137d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:37.822587 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee76093b-9c81-49b9-b544-31436943137d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:37.823026 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee76093b-9c81-49b9-b544-31436943137d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:37.960205 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ee76093b-9c81-49b9-b544-31436943137d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:37.968344 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ee76093b-9c81-49b9-b544-31436943137d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.158927 Jul 21 08:31:37.968948 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 85/165] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:37 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:38.220395 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba52e2a0-8670-4955-b686-bfad168927ac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:38.221002 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba52e2a0-8670-4955-b686-bfad168927ac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:38.227148 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba52e2a0-8670-4955-b686-bfad168927ac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:38.227624 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba52e2a0-8670-4955-b686-bfad168927ac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:38.228384 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba52e2a0-8670-4955-b686-bfad168927ac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:38.228817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba52e2a0-8670-4955-b686-bfad168927ac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:38.359996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba52e2a0-8670-4955-b686-bfad168927ac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:38.367376 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba52e2a0-8670-4955-b686-bfad168927ac tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.150760 Jul 21 08:31:38.367952 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 81/166] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:38 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:38.985334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2ac125fc-3057-468c-9d29-e4b565ed796c tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:38.985954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2ac125fc-3057-468c-9d29-e4b565ed796c tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:38.992856 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2ac125fc-3057-468c-9d29-e4b565ed796c tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:38.993306 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2ac125fc-3057-468c-9d29-e4b565ed796c tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:38.994106 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2ac125fc-3057-468c-9d29-e4b565ed796c tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:38.994546 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2ac125fc-3057-468c-9d29-e4b565ed796c tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:39.131409 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2ac125fc-3057-468c-9d29-e4b565ed796c tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:39.139047 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2ac125fc-3057-468c-9d29-e4b565ed796c tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.157603 Jul 21 08:31:39.139652 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 86/167] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:38 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:39.385182 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb12ff88-fdce-4131-b524-7472752229dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:39.385939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb12ff88-fdce-4131-b524-7472752229dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:39.392543 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb12ff88-fdce-4131-b524-7472752229dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:39.393074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb12ff88-fdce-4131-b524-7472752229dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:39.393901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb12ff88-fdce-4131-b524-7472752229dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:39.394384 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb12ff88-fdce-4131-b524-7472752229dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:39.537358 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb12ff88-fdce-4131-b524-7472752229dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:39.545773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb12ff88-fdce-4131-b524-7472752229dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.164788 Jul 21 08:31:39.556937 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 82/168] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:39 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:39.756677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e1a4a1bc-02ad-4e52-bb7e-effccde0b9cc tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:39.757170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e1a4a1bc-02ad-4e52-bb7e-effccde0b9cc tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:39.763368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1a4a1bc-02ad-4e52-bb7e-effccde0b9cc tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:39.763728 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1a4a1bc-02ad-4e52-bb7e-effccde0b9cc tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:39.764488 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1a4a1bc-02ad-4e52-bb7e-effccde0b9cc tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:39.764910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1a4a1bc-02ad-4e52-bb7e-effccde0b9cc tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:39.788692 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e1a4a1bc-02ad-4e52-bb7e-effccde0b9cc tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:31:39.876189 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e1a4a1bc-02ad-4e52-bb7e-effccde0b9cc tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 204 len: 0 microversion: 2.1 time: 0.123007 Jul 21 08:31:39.876769 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 87/169] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:31:39 2022] DELETE /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:31:39.885762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-20a6fbf2-04ee-4ff3-89e7-5ad473fdbf30 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:39.886401 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-20a6fbf2-04ee-4ff3-89e7-5ad473fdbf30 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:39.894708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20a6fbf2-04ee-4ff3-89e7-5ad473fdbf30 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:39.895150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20a6fbf2-04ee-4ff3-89e7-5ad473fdbf30 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:39.897699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20a6fbf2-04ee-4ff3-89e7-5ad473fdbf30 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:39.907506 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20a6fbf2-04ee-4ff3-89e7-5ad473fdbf30 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:40.052308 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-20a6fbf2-04ee-4ff3-89e7-5ad473fdbf30 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:40.066122 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-20a6fbf2-04ee-4ff3-89e7-5ad473fdbf30 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1554 microversion: 2.1 time: 0.184460 Jul 21 08:31:40.066844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 83/170] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:39 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:40.157483 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e623cb52-6d77-4838-80b4-324c0fb4cda1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:40.158334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e623cb52-6d77-4838-80b4-324c0fb4cda1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:40.166085 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e623cb52-6d77-4838-80b4-324c0fb4cda1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:40.166535 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e623cb52-6d77-4838-80b4-324c0fb4cda1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:40.167373 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e623cb52-6d77-4838-80b4-324c0fb4cda1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:40.167905 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e623cb52-6d77-4838-80b4-324c0fb4cda1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:40.333867 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e623cb52-6d77-4838-80b4-324c0fb4cda1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:40.341274 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e623cb52-6d77-4838-80b4-324c0fb4cda1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.189067 Jul 21 08:31:40.341847 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 88/171] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:40 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:40.565017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fcb46c2a-d2f1-42fd-b98b-a8e89b5af02e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:40.565839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fcb46c2a-d2f1-42fd-b98b-a8e89b5af02e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:40.572123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcb46c2a-d2f1-42fd-b98b-a8e89b5af02e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:40.572568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcb46c2a-d2f1-42fd-b98b-a8e89b5af02e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:40.573336 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcb46c2a-d2f1-42fd-b98b-a8e89b5af02e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:40.573774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcb46c2a-d2f1-42fd-b98b-a8e89b5af02e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:40.733613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcb46c2a-d2f1-42fd-b98b-a8e89b5af02e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:40.743065 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fcb46c2a-d2f1-42fd-b98b-a8e89b5af02e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.182477 Jul 21 08:31:40.743813 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 84/172] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:40 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:41.084530 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-063543ec-8a81-4461-b0c7-818f5dd647ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:41.085255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-063543ec-8a81-4461-b0c7-818f5dd647ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:41.093104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-063543ec-8a81-4461-b0c7-818f5dd647ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:41.093784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-063543ec-8a81-4461-b0c7-818f5dd647ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:41.094755 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-063543ec-8a81-4461-b0c7-818f5dd647ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:41.095718 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-063543ec-8a81-4461-b0c7-818f5dd647ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:41.246475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-063543ec-8a81-4461-b0c7-818f5dd647ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:41.256200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-063543ec-8a81-4461-b0c7-818f5dd647ff tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1554 microversion: 2.1 time: 0.175915 Jul 21 08:31:41.256856 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 89/173] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:41 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:41.358865 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84d118c0-a7c2-446d-94e5-f4c1e9d95e0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:41.359847 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84d118c0-a7c2-446d-94e5-f4c1e9d95e0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:41.366211 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84d118c0-a7c2-446d-94e5-f4c1e9d95e0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:41.367032 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84d118c0-a7c2-446d-94e5-f4c1e9d95e0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:41.367938 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84d118c0-a7c2-446d-94e5-f4c1e9d95e0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:41.368464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84d118c0-a7c2-446d-94e5-f4c1e9d95e0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:41.545968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84d118c0-a7c2-446d-94e5-f4c1e9d95e0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:41.553843 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84d118c0-a7c2-446d-94e5-f4c1e9d95e0f tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.199280 Jul 21 08:31:41.554957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 85/174] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:41 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:41.762283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-afc2c8d1-c301-428d-b1d7-8173f01bcaba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:41.762902 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-afc2c8d1-c301-428d-b1d7-8173f01bcaba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:41.770412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-afc2c8d1-c301-428d-b1d7-8173f01bcaba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:41.771266 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-afc2c8d1-c301-428d-b1d7-8173f01bcaba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:41.772294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-afc2c8d1-c301-428d-b1d7-8173f01bcaba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:41.773090 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-afc2c8d1-c301-428d-b1d7-8173f01bcaba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:41.922907 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-afc2c8d1-c301-428d-b1d7-8173f01bcaba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:41.931824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-afc2c8d1-c301-428d-b1d7-8173f01bcaba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.174148 Jul 21 08:31:41.932572 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 90/175] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:41 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:42.275454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-42aa16d9-e3b9-4ad7-8016-4bc4abf1de27 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:42.278169 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-42aa16d9-e3b9-4ad7-8016-4bc4abf1de27 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:42.288663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42aa16d9-e3b9-4ad7-8016-4bc4abf1de27 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:42.289354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42aa16d9-e3b9-4ad7-8016-4bc4abf1de27 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:42.290237 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42aa16d9-e3b9-4ad7-8016-4bc4abf1de27 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:42.291315 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-42aa16d9-e3b9-4ad7-8016-4bc4abf1de27 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:42.458897 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-42aa16d9-e3b9-4ad7-8016-4bc4abf1de27 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:42.467363 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-42aa16d9-e3b9-4ad7-8016-4bc4abf1de27 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1554 microversion: 2.1 time: 0.197351 Jul 21 08:31:42.476976 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 86/176] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:42 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:42.571745 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7b4b4d05-5975-46e0-a6e9-750b3854a503 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:42.572363 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7b4b4d05-5975-46e0-a6e9-750b3854a503 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:42.580379 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b4b4d05-5975-46e0-a6e9-750b3854a503 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:42.580764 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b4b4d05-5975-46e0-a6e9-750b3854a503 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:42.581544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b4b4d05-5975-46e0-a6e9-750b3854a503 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:42.581978 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b4b4d05-5975-46e0-a6e9-750b3854a503 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:42.739883 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b4b4d05-5975-46e0-a6e9-750b3854a503 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:42.750937 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7b4b4d05-5975-46e0-a6e9-750b3854a503 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1319 microversion: 2.1 time: 0.183471 Jul 21 08:31:42.751560 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 91/177] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:42 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:42.948820 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a4810689-ceae-4fda-b09a-353f92dc9869 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:42.949345 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a4810689-ceae-4fda-b09a-353f92dc9869 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:42.955305 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4810689-ceae-4fda-b09a-353f92dc9869 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:42.955801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4810689-ceae-4fda-b09a-353f92dc9869 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:42.956557 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4810689-ceae-4fda-b09a-353f92dc9869 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:42.956989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4810689-ceae-4fda-b09a-353f92dc9869 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:43.092550 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a4810689-ceae-4fda-b09a-353f92dc9869 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:43.103227 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a4810689-ceae-4fda-b09a-353f92dc9869 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.158355 Jul 21 08:31:43.103833 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 87/178] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:42 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:43.491140 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a3e61998-0b5a-4623-8076-02ede975181e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:43.491789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a3e61998-0b5a-4623-8076-02ede975181e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:43.497821 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3e61998-0b5a-4623-8076-02ede975181e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:43.498439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3e61998-0b5a-4623-8076-02ede975181e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:43.499203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3e61998-0b5a-4623-8076-02ede975181e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:43.499682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3e61998-0b5a-4623-8076-02ede975181e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:43.503977 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:43.645648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a3e61998-0b5a-4623-8076-02ede975181e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:43.654247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a3e61998-0b5a-4623-8076-02ede975181e tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1554 microversion: 2.1 time: 0.173317 Jul 21 08:31:43.654820 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 92/179] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:43 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:43.768092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48ed21af-0dab-4281-933b-282e5a7915a9 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:43.768722 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48ed21af-0dab-4281-933b-282e5a7915a9 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:43.774715 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48ed21af-0dab-4281-933b-282e5a7915a9 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:43.775154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48ed21af-0dab-4281-933b-282e5a7915a9 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:43.775941 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48ed21af-0dab-4281-933b-282e5a7915a9 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:43.776367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48ed21af-0dab-4281-933b-282e5a7915a9 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:43.935710 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48ed21af-0dab-4281-933b-282e5a7915a9 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:43.943176 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48ed21af-0dab-4281-933b-282e5a7915a9 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1509 microversion: 2.1 time: 0.178909 Jul 21 08:31:43.943890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 88/180] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:43 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:44.120942 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-82a5efc9-1483-42d3-8b34-4ed604abe6d8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:44.121550 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-82a5efc9-1483-42d3-8b34-4ed604abe6d8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:44.128226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82a5efc9-1483-42d3-8b34-4ed604abe6d8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:44.128777 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82a5efc9-1483-42d3-8b34-4ed604abe6d8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:44.129820 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82a5efc9-1483-42d3-8b34-4ed604abe6d8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:44.130253 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82a5efc9-1483-42d3-8b34-4ed604abe6d8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:44.261199 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-82a5efc9-1483-42d3-8b34-4ed604abe6d8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:44.269160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-82a5efc9-1483-42d3-8b34-4ed604abe6d8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.152429 Jul 21 08:31:44.270041 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 93/181] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:44 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:44.671553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-314ece27-c9de-4c3a-99a6-e2e94fcfcc25 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:44.672160 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-314ece27-c9de-4c3a-99a6-e2e94fcfcc25 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:44.678226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-314ece27-c9de-4c3a-99a6-e2e94fcfcc25 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:44.678669 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-314ece27-c9de-4c3a-99a6-e2e94fcfcc25 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:44.679451 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-314ece27-c9de-4c3a-99a6-e2e94fcfcc25 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:44.679881 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-314ece27-c9de-4c3a-99a6-e2e94fcfcc25 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:44.807743 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-314ece27-c9de-4c3a-99a6-e2e94fcfcc25 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:44.815618 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-314ece27-c9de-4c3a-99a6-e2e94fcfcc25 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1554 microversion: 2.1 time: 0.148463 Jul 21 08:31:44.816190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 89/182] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:44 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:45.285941 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ce980bef-ad4a-4fbe-87c3-dc876bc7d409 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:45.286559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ce980bef-ad4a-4fbe-87c3-dc876bc7d409 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:45.293057 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce980bef-ad4a-4fbe-87c3-dc876bc7d409 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:45.293508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce980bef-ad4a-4fbe-87c3-dc876bc7d409 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:45.294267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce980bef-ad4a-4fbe-87c3-dc876bc7d409 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:45.294703 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce980bef-ad4a-4fbe-87c3-dc876bc7d409 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:45.433834 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ce980bef-ad4a-4fbe-87c3-dc876bc7d409 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:45.441721 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ce980bef-ad4a-4fbe-87c3-dc876bc7d409 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.159470 Jul 21 08:31:45.442410 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 94/183] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:45 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:45.834344 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-053d5764-c5c3-41fa-b9e3-62f248ab57e7 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:45.834961 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-053d5764-c5c3-41fa-b9e3-62f248ab57e7 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:45.841196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-053d5764-c5c3-41fa-b9e3-62f248ab57e7 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:45.841627 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-053d5764-c5c3-41fa-b9e3-62f248ab57e7 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:45.842439 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-053d5764-c5c3-41fa-b9e3-62f248ab57e7 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:45.842839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-053d5764-c5c3-41fa-b9e3-62f248ab57e7 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:45.984529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-053d5764-c5c3-41fa-b9e3-62f248ab57e7 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:45.992951 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-053d5764-c5c3-41fa-b9e3-62f248ab57e7 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1554 microversion: 2.1 time: 0.164027 Jul 21 08:31:45.993521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 90/184] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:45 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:46.458829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e62b9cac-6aa5-41e9-adb8-ae6cc2c70f4c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:46.459534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e62b9cac-6aa5-41e9-adb8-ae6cc2c70f4c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:46.461861 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:46.472590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e62b9cac-6aa5-41e9-adb8-ae6cc2c70f4c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:46.472590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e62b9cac-6aa5-41e9-adb8-ae6cc2c70f4c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:46.472590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e62b9cac-6aa5-41e9-adb8-ae6cc2c70f4c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:46.473075 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e62b9cac-6aa5-41e9-adb8-ae6cc2c70f4c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:47.017890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-38191138-bed9-487c-a4e1-00621c2aedc8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:47.019890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-38191138-bed9-487c-a4e1-00621c2aedc8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:47.021170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e62b9cac-6aa5-41e9-adb8-ae6cc2c70f4c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:47.028936 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e62b9cac-6aa5-41e9-adb8-ae6cc2c70f4c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.573865 Jul 21 08:31:47.030867 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 95/185] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:46 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:31:47.053101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38191138-bed9-487c-a4e1-00621c2aedc8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:47.054353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38191138-bed9-487c-a4e1-00621c2aedc8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:47.055468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38191138-bed9-487c-a4e1-00621c2aedc8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:47.056057 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38191138-bed9-487c-a4e1-00621c2aedc8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:47.213429 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-38191138-bed9-487c-a4e1-00621c2aedc8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:47.221494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-38191138-bed9-487c-a4e1-00621c2aedc8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1554 microversion: 2.1 time: 0.214434 Jul 21 08:31:47.222294 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 91/186] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:47 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:47.384888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-1dc46c55-4146-4c11-a859-d7d36a969700 req-ff02f8a7-e7c1-4847-abb8-2467bda4c14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2248844f-40e4-41cb-aa40-cdd614390793", "name": "network-vif-deleted", "tag": "411d3f73-9846-4340-8e3f-ffc3a9ff1fa5"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:47.395027 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-1dc46c55-4146-4c11-a859-d7d36a969700 req-ff02f8a7-e7c1-4847-abb8-2467bda4c14c service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:47.395836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-1dc46c55-4146-4c11-a859-d7d36a969700 req-ff02f8a7-e7c1-4847-abb8-2467bda4c14c service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:47.410211 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-1dc46c55-4146-4c11-a859-d7d36a969700 req-ff02f8a7-e7c1-4847-abb8-2467bda4c14c service nova] Creating event network-vif-deleted:411d3f73-9846-4340-8e3f-ffc3a9ff1fa5 for instance 2248844f-40e4-41cb-aa40-cdd614390793 on hv-cinder-85032 Jul 21 08:31:47.415823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-1dc46c55-4146-4c11-a859-d7d36a969700 req-ff02f8a7-e7c1-4847-abb8-2467bda4c14c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034905 Jul 21 08:31:47.417877 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 96/187] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:31:48.048792 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd6e2967-91e1-481b-9388-7db6d0c37567 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:48.049408 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd6e2967-91e1-481b-9388-7db6d0c37567 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:48.059452 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd6e2967-91e1-481b-9388-7db6d0c37567 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:48.060270 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd6e2967-91e1-481b-9388-7db6d0c37567 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:48.061492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd6e2967-91e1-481b-9388-7db6d0c37567 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:48.062436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd6e2967-91e1-481b-9388-7db6d0c37567 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:48.243231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:48.244029 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:48.254245 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:48.254718 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:48.259655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:48.260117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:48.325447 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd6e2967-91e1-481b-9388-7db6d0c37567 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:48.333831 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd6e2967-91e1-481b-9388-7db6d0c37567 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.288877 Jul 21 08:31:48.337867 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:48.338557 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:48.339194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lazy-loading 'fault' on Instance uuid 2248844f-40e4-41cb-aa40-cdd614390793 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:31:48.343978 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 92/188] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:48 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:48.407836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2465817c3ba340f4870debf937929499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d95f75c84d445f9ec31e4a0e8d3953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:48.418251 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2b3c38db-b3ab-4b0a-a020-323a411b51fe tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 200 len: 1351 microversion: 2.1 time: 0.181168 Jul 21 08:31:48.419897 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 97/189] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:48 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 1351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:49.350818 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77455deb-4321-416b-a715-bca601bc1742 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:49.351629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77455deb-4321-416b-a715-bca601bc1742 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:49.358758 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77455deb-4321-416b-a715-bca601bc1742 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:49.359364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77455deb-4321-416b-a715-bca601bc1742 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:49.360240 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77455deb-4321-416b-a715-bca601bc1742 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:49.360743 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77455deb-4321-416b-a715-bca601bc1742 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:49.436267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:49.437024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:49.445757 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:49.446213 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:49.446990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:49.447450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:49.468947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] HTTP exception thrown: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Request method failure captured: Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 HTTP/1.1 Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q6hynK5Bste1IFXvW9BmvAd_QfUfAMwtiO68Brpx3rdRhGe2AeujXtiU9vGNIWS5VZ_jBQKR2wvZwco7vPnMUQjomxmcYZeZbGe21BQsG1xp49qL3c-WiW3i94BtPwaj8nJ6vx-xMpVyxm0EE16aUrRKTQPGgk6COGyp5jARqO7vT0 Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 90d95f75c84d445f9ec31e4a0e8d3953 Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:31:49.474239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 90d95f75c84d445f9ec31e4a0e8d3953 Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-DeleteServersTestJSON-1885238004-project Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 2465817c3ba340f4870debf937929499 Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-DeleteServersTestJSON-1885238004-project Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.475823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '2248844f-40e4-41cb-aa40-cdd614390793'} Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:31:49.476677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.477808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.480155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Returning 404 to user: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:31:49.481228 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7aa40caf-7862-4d89-9e40-6a64532b1706 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 404 len: 111 microversion: 2.1 time: 0.049698 Jul 21 08:31:49.485373 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 98/190] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:49 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:31:49.638810 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:49.640753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:49.648730 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:49.649521 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:49.651221 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:49.651989 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:49.653994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-77455deb-4321-416b-a715-bca601bc1742 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:49.659813 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:49.664835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77455deb-4321-416b-a715-bca601bc1742 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.317949 Jul 21 08:31:49.674984 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 93/191] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:49 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:49.682450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] HTTP exception thrown: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Request method failure captured: Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793/os-volume_attachments HTTP/1.1 Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q6hynK5Bste1IFXvW9BmvAd_QfUfAMwtiO68Brpx3rdRhGe2AeujXtiU9vGNIWS5VZ_jBQKR2wvZwco7vPnMUQjomxmcYZeZbGe21BQsG1xp49qL3c-WiW3i94BtPwaj8nJ6vx-xMpVyxm0EE16aUrRKTQPGgk6COGyp5jARqO7vT0 Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 90d95f75c84d445f9ec31e4a0e8d3953 Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:31:49.700895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 90d95f75c84d445f9ec31e4a0e8d3953 Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-DeleteServersTestJSON-1885238004-project Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 2465817c3ba340f4870debf937929499 Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-DeleteServersTestJSON-1885238004-project Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.702431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '2248844f-40e4-41cb-aa40-cdd614390793'} Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:31:49.703101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:49.704252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:49.705522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Returning 404 to user: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:31:49.705522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a9b3374c-4064-4cf5-8eae-f84f127d1ea8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067251 Jul 21 08:31:49.712401 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 99/192] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:31:49 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:31:50.683810 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4d8160e0-53cd-4902-a275-b2446e0a5933 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:50.684513 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4d8160e0-53cd-4902-a275-b2446e0a5933 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:50.688356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=66 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:50.701308 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d8160e0-53cd-4902-a275-b2446e0a5933 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:50.702019 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d8160e0-53cd-4902-a275-b2446e0a5933 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:50.703122 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d8160e0-53cd-4902-a275-b2446e0a5933 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:50.712615 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d8160e0-53cd-4902-a275-b2446e0a5933 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:50.894801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4d8160e0-53cd-4902-a275-b2446e0a5933 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:50.906527 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4d8160e0-53cd-4902-a275-b2446e0a5933 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.228006 Jul 21 08:31:50.907194 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 94/193] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:50 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:50.957532 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:50.958120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:50.967876 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:50.968394 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:50.969416 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:50.970352 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:50.989169 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] HTTP exception thrown: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Request method failure captured: Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 HTTP/1.1 Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q6hynK5Bste1IFXvW9BmvAd_QfUfAMwtiO68Brpx3rdRhGe2AeujXtiU9vGNIWS5VZ_jBQKR2wvZwco7vPnMUQjomxmcYZeZbGe21BQsG1xp49qL3c-WiW3i94BtPwaj8nJ6vx-xMpVyxm0EE16aUrRKTQPGgk6COGyp5jARqO7vT0 Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 90d95f75c84d445f9ec31e4a0e8d3953 Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:31:50.990796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 90d95f75c84d445f9ec31e4a0e8d3953 Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-DeleteServersTestJSON-1885238004-project Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 2465817c3ba340f4870debf937929499 Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-DeleteServersTestJSON-1885238004-project Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:50.992069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '2248844f-40e4-41cb-aa40-cdd614390793'} Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:31:50.992781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:50.993849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:31:50.995103 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Returning 404 to user: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:31:50.995103 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-82124bf4-6384-45e0-8a98-8f8a16f85018 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 404 len: 111 microversion: 2.1 time: 0.040136 Jul 21 08:31:50.995103 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 100/194] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:31:50 2022] DELETE /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:31:51.001185 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:51.001797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] [instance: 2248844f-40e4-41cb-aa40-cdd614390793] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:51.008163 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:51.008610 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:51.009377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:51.009805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:51.024399 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] HTTP exception thrown: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Request method failure captured: Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 HTTP/1.1 Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6hynK5Bste1IFXvW9BmvAd_QfUfAMwtiO68Brpx3rdRhGe2AeujXtiU9vGNIWS5VZ_jBQKR2wvZwco7vPnMUQjomxmcYZeZbGe21BQsG1xp49qL3c-WiW3i94BtPwaj8nJ6vx-xMpVyxm0EE16aUrRKTQPGgk6COGyp5jARqO7vT0 Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 90d95f75c84d445f9ec31e4a0e8d3953 Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:31:51.043445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/90d95f75c84d445f9ec31e4a0e8d3953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 90d95f75c84d445f9ec31e4a0e8d3953 Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1885238004 Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-DeleteServersTestJSON-1885238004-project Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 2465817c3ba340f4870debf937929499 Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-DeleteServersTestJSON-1885238004-project Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:51.045154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2248844f-40e4-41cb-aa40-cdd614390793'} Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:31:51.045822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. Jul 21 08:31:51.046873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:31:51.048393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] Returning 404 to user: Instance 2248844f-40e4-41cb-aa40-cdd614390793 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:31:51.048393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c56345e0-30c7-4e9c-b850-4c5122bab0d8 tempest-DeleteServersTestJSON-1885238004 tempest-DeleteServersTestJSON-1885238004-project] 10.222.0.47 "GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793" status: 404 len: 111 microversion: 2.1 time: 0.047658 Jul 21 08:31:51.048393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 95/195] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:50 2022] GET /compute/v2.1/servers/2248844f-40e4-41cb-aa40-cdd614390793 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:31:51.926556 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9de811a8-95fe-491f-b611-f50402c066b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:51.927452 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9de811a8-95fe-491f-b611-f50402c066b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:51.934487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9de811a8-95fe-491f-b611-f50402c066b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:51.934929 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9de811a8-95fe-491f-b611-f50402c066b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:51.936030 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9de811a8-95fe-491f-b611-f50402c066b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:51.936616 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9de811a8-95fe-491f-b611-f50402c066b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:52.142749 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9de811a8-95fe-491f-b611-f50402c066b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:52.159915 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9de811a8-95fe-491f-b611-f50402c066b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.236389 Jul 21 08:31:52.173562 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 101/196] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:51 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:53.186137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-19294c38-f9b9-43e1-82b4-536343de2044 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:53.187300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-19294c38-f9b9-43e1-82b4-536343de2044 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:53.209545 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19294c38-f9b9-43e1-82b4-536343de2044 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:53.209994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19294c38-f9b9-43e1-82b4-536343de2044 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:53.212257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19294c38-f9b9-43e1-82b4-536343de2044 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:53.212737 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19294c38-f9b9-43e1-82b4-536343de2044 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:53.461031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-19294c38-f9b9-43e1-82b4-536343de2044 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:53.469593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-19294c38-f9b9-43e1-82b4-536343de2044 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.291336 Jul 21 08:31:53.472182 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 96/197] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:53 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:54.495496 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dde4b42e-d085-4a66-b6c6-e2d205c9d1b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:54.496700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dde4b42e-d085-4a66-b6c6-e2d205c9d1b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:54.507851 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dde4b42e-d085-4a66-b6c6-e2d205c9d1b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:54.514054 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dde4b42e-d085-4a66-b6c6-e2d205c9d1b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:54.515423 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dde4b42e-d085-4a66-b6c6-e2d205c9d1b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:54.516083 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dde4b42e-d085-4a66-b6c6-e2d205c9d1b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:54.956603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dde4b42e-d085-4a66-b6c6-e2d205c9d1b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:54.980977 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dde4b42e-d085-4a66-b6c6-e2d205c9d1b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.487556 Jul 21 08:31:54.982821 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 102/198] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:54 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:55.999619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3dd3fa20-79d0-45e1-b8f0-35485015801d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:56.000482 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3dd3fa20-79d0-45e1-b8f0-35485015801d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:56.008887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dd3fa20-79d0-45e1-b8f0-35485015801d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:56.009349 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dd3fa20-79d0-45e1-b8f0-35485015801d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:56.010371 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dd3fa20-79d0-45e1-b8f0-35485015801d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:56.010884 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dd3fa20-79d0-45e1-b8f0-35485015801d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:56.391996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3dd3fa20-79d0-45e1-b8f0-35485015801d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:56.406661 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3dd3fa20-79d0-45e1-b8f0-35485015801d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.407932 Jul 21 08:31:56.407465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 97/199] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:55 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:57.423739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d9bf49c8-c67f-4659-b1c3-3cabed412d0d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:57.424903 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d9bf49c8-c67f-4659-b1c3-3cabed412d0d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:57.431305 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9bf49c8-c67f-4659-b1c3-3cabed412d0d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:57.431784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9bf49c8-c67f-4659-b1c3-3cabed412d0d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:57.433089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9bf49c8-c67f-4659-b1c3-3cabed412d0d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:57.433524 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9bf49c8-c67f-4659-b1c3-3cabed412d0d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:57.600470 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d9bf49c8-c67f-4659-b1c3-3cabed412d0d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:57.612388 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d9bf49c8-c67f-4659-b1c3-3cabed412d0d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.192839 Jul 21 08:31:57.623621 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 103/200] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:57 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:57.706318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-990997656", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "networks": [{"uuid": "4bc2d983-362e-470f-80f5-bbc798d9d507"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:57.785098 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] validate_networks() for [('4bc2d983-362e-470f-80f5-bbc798d9d507', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:31:58.022281 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e23db443-570b-4300-93c2-f2137824adaf tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Action: 'create', calling method: .version_select at 0x7f65bceab310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-149585788"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:31:58.172606 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:31:58.173051 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:31:58.173919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:31:58.174220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:31:58.174849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:31:58.184798 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:58.185337 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:58.186563 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:58.186996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:58.212082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Getting quotas for project 6c163cbb79544869bb823308163a4142. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:31:58.216699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Getting quotas for user aa156584880d4449bd89a7bcdcfe403f and project 6c163cbb79544869bb823308163a4142. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:31:58.228403 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:31:58.231973 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:31:58.290856 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-94fabf00-d11a-412d-9185-f7210449ac30 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588003 Jul 21 08:31:58.295485 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 98/201] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:31:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:31:58.307779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a32b97f-30b0-4048-840c-e5ab762482d2 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:58.308595 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a32b97f-30b0-4048-840c-e5ab762482d2 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:58.373743 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a32b97f-30b0-4048-840c-e5ab762482d2 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:58.382575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a32b97f-30b0-4048-840c-e5ab762482d2 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1213 microversion: 2.1 time: 0.081219 Jul 21 08:31:58.383482 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 99/202] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:58 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:58.397669 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e23db443-570b-4300-93c2-f2137824adaf tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.500344 Jul 21 08:31:58.398475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 104/203] 10.222.0.47 () {60 vars in 1154 bytes} [Thu Jul 21 08:31:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 502 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 21 08:31:58.410250 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-adea7f4a-0acb-4c9f-90ac-a4618591a4ae tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65becf6e50>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:58.478382 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-adea7f4a-0acb-4c9f-90ac-a4618591a4ae tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 200 len: 344 microversion: 2.1 time: 0.072149 Jul 21 08:31:58.479306 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 100/204] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:31:58 2022] GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:31:58.632052 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b6bff010-f6d9-4a29-b32f-e7a2f763c734 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:58.632918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b6bff010-f6d9-4a29-b32f-e7a2f763c734 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:58.640367 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6bff010-f6d9-4a29-b32f-e7a2f763c734 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:58.641175 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6bff010-f6d9-4a29-b32f-e7a2f763c734 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:58.641961 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6bff010-f6d9-4a29-b32f-e7a2f763c734 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:58.643001 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6bff010-f6d9-4a29-b32f-e7a2f763c734 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:58.840302 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6bff010-f6d9-4a29-b32f-e7a2f763c734 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:58.848242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b6bff010-f6d9-4a29-b32f-e7a2f763c734 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.221455 Jul 21 08:31:58.848876 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 105/205] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:58 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:59.400724 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84d74e19-6ed2-46a2-9554-2c24497caadf tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:59.402199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84d74e19-6ed2-46a2-9554-2c24497caadf tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:59.410294 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84d74e19-6ed2-46a2-9554-2c24497caadf tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:59.411084 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84d74e19-6ed2-46a2-9554-2c24497caadf tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:59.411929 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84d74e19-6ed2-46a2-9554-2c24497caadf tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:59.412545 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84d74e19-6ed2-46a2-9554-2c24497caadf tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:59.491304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bb5e45fb-3008-4b6f-9d57-b10bcb59d590 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bcda6940>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:59.498878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84d74e19-6ed2-46a2-9554-2c24497caadf tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:31:59.508555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84d74e19-6ed2-46a2-9554-2c24497caadf tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1217 microversion: 2.1 time: 0.111744 Jul 21 08:31:59.509133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 101/206] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:59 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:31:59.548310 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bb5e45fb-3008-4b6f-9d57-b10bcb59d590 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 200 len: 344 microversion: 2.1 time: 0.060761 Jul 21 08:31:59.548872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 106/207] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:31:59 2022] GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:31:59.868357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d32274e-816b-4776-ba66-eb636aa078e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:31:59.868886 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d32274e-816b-4776-ba66-eb636aa078e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:31:59.875639 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d32274e-816b-4776-ba66-eb636aa078e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:59.876441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d32274e-816b-4776-ba66-eb636aa078e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:31:59.877431 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d32274e-816b-4776-ba66-eb636aa078e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:31:59.878440 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d32274e-816b-4776-ba66-eb636aa078e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:00.036044 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d32274e-816b-4776-ba66-eb636aa078e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:00.044165 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d32274e-816b-4776-ba66-eb636aa078e9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.179982 Jul 21 08:32:00.044894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 102/208] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:31:59 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:00.526097 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-42852eee-edc0-4b88-9055-a9320f052e9c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:00.526814 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-42852eee-edc0-4b88-9055-a9320f052e9c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:00.536193 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42852eee-edc0-4b88-9055-a9320f052e9c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:00.536742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42852eee-edc0-4b88-9055-a9320f052e9c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:00.537728 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42852eee-edc0-4b88-9055-a9320f052e9c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:00.538590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42852eee-edc0-4b88-9055-a9320f052e9c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:00.560768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15cb0c70-3f9b-4559-ba61-bfe03c658dfc tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bc6df3a0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:00.611152 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-42852eee-edc0-4b88-9055-a9320f052e9c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:00.627619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15cb0c70-3f9b-4559-ba61-bfe03c658dfc tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 200 len: 344 microversion: 2.1 time: 0.065183 Jul 21 08:32:00.627619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 103/209] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:32:00 2022] GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:32:00.628117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-42852eee-edc0-4b88-9055-a9320f052e9c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1217 microversion: 2.1 time: 0.102724 Jul 21 08:32:00.628117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 107/210] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:00 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:01.061162 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60739ec9-73ab-4c8d-8cc1-d536c87bbcea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:01.061824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60739ec9-73ab-4c8d-8cc1-d536c87bbcea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:01.067868 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60739ec9-73ab-4c8d-8cc1-d536c87bbcea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:01.068325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60739ec9-73ab-4c8d-8cc1-d536c87bbcea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:01.069075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60739ec9-73ab-4c8d-8cc1-d536c87bbcea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:01.069501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60739ec9-73ab-4c8d-8cc1-d536c87bbcea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:01.227028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60739ec9-73ab-4c8d-8cc1-d536c87bbcea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:01.235988 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60739ec9-73ab-4c8d-8cc1-d536c87bbcea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.178711 Jul 21 08:32:01.236588 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 104/211] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:01 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:01.635197 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-869a4014-8cff-43e3-8947-f488aeed0c95 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bcec3b80>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:01.644325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-14c71dd6-af16-41ce-baec-20ed638adc98 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:01.645519 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-14c71dd6-af16-41ce-baec-20ed638adc98 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:01.662485 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14c71dd6-af16-41ce-baec-20ed638adc98 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:01.665557 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14c71dd6-af16-41ce-baec-20ed638adc98 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:01.666441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14c71dd6-af16-41ce-baec-20ed638adc98 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:01.666880 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14c71dd6-af16-41ce-baec-20ed638adc98 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:01.714676 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-869a4014-8cff-43e3-8947-f488aeed0c95 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 200 len: 345 microversion: 2.1 time: 0.083941 Jul 21 08:32:01.721315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 108/212] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:32:01 2022] GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:01.726791 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-929260eb-8d07-428d-a745-b93b977d9027 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Action: 'create', calling method: .version_select at 0x7f65bcda6940>, body: {"snapshot": {"volume_id": "25317b8f-3d03-4898-b416-b3f14a625b3f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1599063597"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:01.792611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-14c71dd6-af16-41ce-baec-20ed638adc98 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:01.806670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-14c71dd6-af16-41ce-baec-20ed638adc98 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1273 microversion: 2.1 time: 0.165856 Jul 21 08:32:01.809461 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 105/213] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:01 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:02.022229 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-929260eb-8d07-428d-a745-b93b977d9027 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.298966 Jul 21 08:32:02.023290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 109/214] 10.222.0.47 () {60 vars in 1161 bytes} [Thu Jul 21 08:32:01 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:32:02.037332 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-70ce1ec0-1bea-435f-8ed2-73d51f748680 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bc6c58b0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:02.124694 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-70ce1ec0-1bea-435f-8ed2-73d51f748680 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 200 len: 287 microversion: 2.1 time: 0.094506 Jul 21 08:32:02.125268 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 106/215] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:32:02 2022] GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:02.137301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-82ba442d-c7b9-4eef-bf38-4e281e7df8a5 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bce55430>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:02.200214 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-82ba442d-c7b9-4eef-bf38-4e281e7df8a5 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.066580 Jul 21 08:32:02.200875 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 110/216] 10.222.0.47 () {58 vars in 1139 bytes} [Thu Jul 21 08:32:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:02.212873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c755b177-4bd8-4a27-8097-d058049c3f9f tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bc6df430>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:02.260024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-001caced-840a-4b3b-9661-d2f874506608 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:02.260695 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-001caced-840a-4b3b-9661-d2f874506608 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:02.267964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c755b177-4bd8-4a27-8097-d058049c3f9f tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 200 len: 287 microversion: 2.1 time: 0.058912 Jul 21 08:32:02.268543 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 107/217] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:32:02 2022] GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:02.279267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-001caced-840a-4b3b-9661-d2f874506608 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:02.279925 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-001caced-840a-4b3b-9661-d2f874506608 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:02.281134 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-001caced-840a-4b3b-9661-d2f874506608 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:02.281780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-001caced-840a-4b3b-9661-d2f874506608 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:02.552198 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-001caced-840a-4b3b-9661-d2f874506608 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:02.568156 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-001caced-840a-4b3b-9661-d2f874506608 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.318164 Jul 21 08:32:02.568969 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 111/218] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:02 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:02.828999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-010909b8-181b-462f-aef6-ff7b0673f50a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:02.830219 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-010909b8-181b-462f-aef6-ff7b0673f50a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:02.840829 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-010909b8-181b-462f-aef6-ff7b0673f50a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:02.841822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-010909b8-181b-462f-aef6-ff7b0673f50a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:02.842946 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-010909b8-181b-462f-aef6-ff7b0673f50a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:02.843594 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-010909b8-181b-462f-aef6-ff7b0673f50a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:03.006375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-010909b8-181b-462f-aef6-ff7b0673f50a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:03.015212 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-010909b8-181b-462f-aef6-ff7b0673f50a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.190366 Jul 21 08:32:03.016106 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 108/219] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:02 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:03.279737 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-565abc9b-a386-4551-a02d-d3f4bd84b275 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bcee88b0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:03.309867 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-565abc9b-a386-4551-a02d-d3f4bd84b275 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 200 len: 287 microversion: 2.1 time: 0.033953 Jul 21 08:32:03.310562 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 112/220] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:32:03 2022] GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:03.585069 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df042d1d-4b5c-431e-85c7-67ea0cd38526 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:03.585675 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df042d1d-4b5c-431e-85c7-67ea0cd38526 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:03.595947 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df042d1d-4b5c-431e-85c7-67ea0cd38526 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:03.596385 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df042d1d-4b5c-431e-85c7-67ea0cd38526 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:03.597154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df042d1d-4b5c-431e-85c7-67ea0cd38526 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:03.597582 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df042d1d-4b5c-431e-85c7-67ea0cd38526 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:03.778824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df042d1d-4b5c-431e-85c7-67ea0cd38526 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:03.788765 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df042d1d-4b5c-431e-85c7-67ea0cd38526 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.207391 Jul 21 08:32:03.789355 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 109/221] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:03 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:04.032804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-527aa6e3-0b5c-4ffe-8806-1c5cbe5d269c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:04.033320 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-527aa6e3-0b5c-4ffe-8806-1c5cbe5d269c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:04.039825 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-527aa6e3-0b5c-4ffe-8806-1c5cbe5d269c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:04.040267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-527aa6e3-0b5c-4ffe-8806-1c5cbe5d269c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:04.041019 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-527aa6e3-0b5c-4ffe-8806-1c5cbe5d269c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:04.042021 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-527aa6e3-0b5c-4ffe-8806-1c5cbe5d269c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:04.175838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-527aa6e3-0b5c-4ffe-8806-1c5cbe5d269c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:04.184518 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-527aa6e3-0b5c-4ffe-8806-1c5cbe5d269c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.155628 Jul 21 08:32:04.185085 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 113/222] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:04 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:04.322090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-997fad6e-8dab-4583-9a4d-a5e61310b0e8 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bc6c5b80>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:04.359306 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-997fad6e-8dab-4583-9a4d-a5e61310b0e8 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 200 len: 287 microversion: 2.1 time: 0.040056 Jul 21 08:32:04.360271 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 110/223] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:32:04 2022] GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:04.806308 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bcc09e03-6ed6-45e6-b736-2f206be02708 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:04.807382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bcc09e03-6ed6-45e6-b736-2f206be02708 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:04.814590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcc09e03-6ed6-45e6-b736-2f206be02708 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:04.815240 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcc09e03-6ed6-45e6-b736-2f206be02708 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:04.816332 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcc09e03-6ed6-45e6-b736-2f206be02708 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:04.817042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcc09e03-6ed6-45e6-b736-2f206be02708 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:04.977358 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bcc09e03-6ed6-45e6-b736-2f206be02708 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:04.985767 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bcc09e03-6ed6-45e6-b736-2f206be02708 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.183380 Jul 21 08:32:04.986406 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 114/224] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:04 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:05.201814 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee6ebf9b-eaeb-4efc-bf80-759bed3f1b89 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:05.202436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee6ebf9b-eaeb-4efc-bf80-759bed3f1b89 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:05.209255 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee6ebf9b-eaeb-4efc-bf80-759bed3f1b89 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:05.209823 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee6ebf9b-eaeb-4efc-bf80-759bed3f1b89 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:05.210933 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee6ebf9b-eaeb-4efc-bf80-759bed3f1b89 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:05.211497 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee6ebf9b-eaeb-4efc-bf80-759bed3f1b89 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:05.376528 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7eeefef2-b9a0-4a98-ad92-8b6be38f3237 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bce55670>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:05.389528 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee6ebf9b-eaeb-4efc-bf80-759bed3f1b89 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:05.402160 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee6ebf9b-eaeb-4efc-bf80-759bed3f1b89 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.204396 Jul 21 08:32:05.412024 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 111/225] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:05 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:05.422964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7eeefef2-b9a0-4a98-ad92-8b6be38f3237 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 200 len: 287 microversion: 2.1 time: 0.053756 Jul 21 08:32:05.423660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 115/226] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:32:05 2022] GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:05.857621 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-f9bfbcad-e3d2-41d6-8f47-2082db2d5d6a req-a3a682e8-6d9e-4968-a347-52c41f272225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579", "tag": "227fda77-0d6a-4a0d-98e1-1530004438e6"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:05.872560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f9bfbcad-e3d2-41d6-8f47-2082db2d5d6a req-a3a682e8-6d9e-4968-a347-52c41f272225 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:05.873224 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f9bfbcad-e3d2-41d6-8f47-2082db2d5d6a req-a3a682e8-6d9e-4968-a347-52c41f272225 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:05.912380 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-f9bfbcad-e3d2-41d6-8f47-2082db2d5d6a req-a3a682e8-6d9e-4968-a347-52c41f272225 service nova] Creating event network-changed:227fda77-0d6a-4a0d-98e1-1530004438e6 for instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 on hv-cinder-85032 Jul 21 08:32:05.918008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-f9bfbcad-e3d2-41d6-8f47-2082db2d5d6a req-a3a682e8-6d9e-4968-a347-52c41f272225 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082512 Jul 21 08:32:05.918635 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 112/227] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:06.005220 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1725a093-0c2d-4356-9996-ba37557fcce5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:06.006354 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1725a093-0c2d-4356-9996-ba37557fcce5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:06.016807 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1725a093-0c2d-4356-9996-ba37557fcce5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:06.017613 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1725a093-0c2d-4356-9996-ba37557fcce5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:06.018584 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1725a093-0c2d-4356-9996-ba37557fcce5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:06.019269 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1725a093-0c2d-4356-9996-ba37557fcce5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:06.248130 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1725a093-0c2d-4356-9996-ba37557fcce5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:06.257866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1725a093-0c2d-4356-9996-ba37557fcce5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.258279 Jul 21 08:32:06.258666 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 116/228] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:05 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:06.421380 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-364c5d88-3ddb-4c54-9fd6-5b890dd21c8e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:06.422926 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-364c5d88-3ddb-4c54-9fd6-5b890dd21c8e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:06.430845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-364c5d88-3ddb-4c54-9fd6-5b890dd21c8e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:06.431503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-364c5d88-3ddb-4c54-9fd6-5b890dd21c8e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:06.433151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-364c5d88-3ddb-4c54-9fd6-5b890dd21c8e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:06.433701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-364c5d88-3ddb-4c54-9fd6-5b890dd21c8e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:06.434651 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c1741e0a-ea38-40bb-a40b-215615ecdcf2 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bce55820>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:06.472488 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c1741e0a-ea38-40bb-a40b-215615ecdcf2 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 200 len: 288 microversion: 2.1 time: 0.041987 Jul 21 08:32:06.479890 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 117/229] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:32:06 2022] GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 288 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:32:06.488743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-486ae929-c604-483c-a76e-6b9ce4d6e74e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bce55310>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:06.593738 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-364c5d88-3ddb-4c54-9fd6-5b890dd21c8e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:06.600047 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-486ae929-c604-483c-a76e-6b9ce4d6e74e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 202 len: 0 microversion: 2.1 time: 0.115489 Jul 21 08:32:06.600613 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 118/230] 10.222.0.47 () {58 vars in 1253 bytes} [Thu Jul 21 08:32:06 2022] DELETE /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:32:06.607275 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-364c5d88-3ddb-4c54-9fd6-5b890dd21c8e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.191416 Jul 21 08:32:06.608161 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 113/231] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:06 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:06.609312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1f7833ca-3ddb-4825-bcbb-333e34745c3c tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bd023040>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:06.639926 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1f7833ca-3ddb-4825-bcbb-333e34745c3c tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 200 len: 287 microversion: 2.1 time: 0.034562 Jul 21 08:32:06.640531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 119/232] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:32:06 2022] GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:32:07.276270 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27393b05-f421-48cf-8804-01f992bbff5e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:07.277248 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27393b05-f421-48cf-8804-01f992bbff5e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:07.283300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27393b05-f421-48cf-8804-01f992bbff5e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:07.283773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27393b05-f421-48cf-8804-01f992bbff5e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:07.284538 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27393b05-f421-48cf-8804-01f992bbff5e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:07.284976 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27393b05-f421-48cf-8804-01f992bbff5e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:07.419867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27393b05-f421-48cf-8804-01f992bbff5e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:07.428024 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27393b05-f421-48cf-8804-01f992bbff5e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.156193 Jul 21 08:32:07.429283 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 114/233] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:07 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:07.624778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-69d72371-52d1-4847-809f-54a7035894bb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:07.625934 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-69d72371-52d1-4847-809f-54a7035894bb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:07.632344 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-69d72371-52d1-4847-809f-54a7035894bb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:07.632789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-69d72371-52d1-4847-809f-54a7035894bb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:07.633558 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-69d72371-52d1-4847-809f-54a7035894bb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:07.633989 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-69d72371-52d1-4847-809f-54a7035894bb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:07.652958 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ad9a2ed-eba7-44a4-9851-354998c80a48 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bc6c5a60>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:07.684029 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-2ad9a2ed-eba7-44a4-9851-354998c80a48 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] HTTP exception thrown: Snapshot 2ce0e72d-5f04-4317-816f-9d0fe4be6319 could not be found. Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ad9a2ed-eba7-44a4-9851-354998c80a48 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Request method failure captured: Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 HTTP/1.1 Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q792BjlpHIENbRdVnEWh6XjKbEenMDrlDPpgP9_ZB031lwTQrFIgQyWMLeDJCv5pzcc48wwH0wM2pqTvLobTDfwJ_wWPEoDQikj0ErXyYKYnBXdxT9V0mN8tMqaN18drzSH9-CWyLONht1rPsceAi3Z-PUDR4-UMTcm205nDc9iXis Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 93539ede044a41b696986aaf5b86da65 Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:32:07.688223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93539ede044a41b696986aaf5b86da65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93539ede044a41b696986aaf5b86da65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93539ede044a41b696986aaf5b86da65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93539ede044a41b696986aaf5b86da65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 93539ede044a41b696986aaf5b86da65 Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotsTestJSON-1037903590-project Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 253aa2f7704e48b59ce4cf39d6ab50ca Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1037903590-project Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Snapshot 2ce0e72d-5f04-4317-816f-9d0fe4be6319 could not be found. Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2ce0e72d-5f04-4317-816f-9d0fe4be6319'} Jul 21 08:32:07.689643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2ce0e72d-5f04-4317-816f-9d0fe4be6319 could not be found. (HTTP 404) (Request-ID: req-4093920d-f844-4bbf-88a8-92ebc5c98c99) Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:07.690590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:32:07.691689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2ce0e72d-5f04-4317-816f-9d0fe4be6319 could not be found. Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 08:32:07.692741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2ce0e72d-5f04-4317-816f-9d0fe4be6319 could not be found. Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2ce0e72d-5f04-4317-816f-9d0fe4be6319 could not be found. Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ad9a2ed-eba7-44a4-9851-354998c80a48 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Returning 404 to user: Snapshot 2ce0e72d-5f04-4317-816f-9d0fe4be6319 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:07.694377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ad9a2ed-eba7-44a4-9851-354998c80a48 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319" status: 404 len: 111 microversion: 2.1 time: 0.041615 Jul 21 08:32:07.695851 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 115/234] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:32:07 2022] GET /compute/v2.1/os-snapshots/2ce0e72d-5f04-4317-816f-9d0fe4be6319 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:32:07.703307 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b49bbaf-76ce-436a-8353-c730cc411161 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bc7e2430>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:07.778164 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b49bbaf-76ce-436a-8353-c730cc411161 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 202 len: 0 microversion: 2.1 time: 0.081292 Jul 21 08:32:07.778917 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 116/235] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:32:07 2022] DELETE /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:32:07.787556 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-595a3cd7-9519-4551-b6cb-ef332ea57343 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65becf6f70>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:07.845721 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-595a3cd7-9519-4551-b6cb-ef332ea57343 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 200 len: 344 microversion: 2.1 time: 0.061918 Jul 21 08:32:07.846318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 117/236] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:32:07 2022] GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:07.870192 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-69d72371-52d1-4847-809f-54a7035894bb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:07.878478 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-69d72371-52d1-4847-809f-54a7035894bb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.257821 Jul 21 08:32:07.879300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 120/237] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:07 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:08.442396 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:08.443356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=8 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:08.449162 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5bc68d14-b6a9-4e65-a120-89d39906c5ea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:08.449958 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5bc68d14-b6a9-4e65-a120-89d39906c5ea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:08.458253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bc68d14-b6a9-4e65-a120-89d39906c5ea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:08.459057 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bc68d14-b6a9-4e65-a120-89d39906c5ea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:08.460120 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bc68d14-b6a9-4e65-a120-89d39906c5ea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:08.460705 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bc68d14-b6a9-4e65-a120-89d39906c5ea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:08.665881 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5bc68d14-b6a9-4e65-a120-89d39906c5ea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:08.675036 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5bc68d14-b6a9-4e65-a120-89d39906c5ea tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.233279 Jul 21 08:32:08.675633 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 118/238] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:08 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:08.859003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80edb718-3f15-465b-b4e2-9f272b150c3e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bcee8940>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:08.893551 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-80edb718-3f15-465b-b4e2-9f272b150c3e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] HTTP exception thrown: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80edb718-3f15-465b-b4e2-9f272b150c3e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Request method failure captured: Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f HTTP/1.1 Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q792BjlpHIENbRdVnEWh6XjKbEenMDrlDPpgP9_ZB031lwTQrFIgQyWMLeDJCv5pzcc48wwH0wM2pqTvLobTDfwJ_wWPEoDQikj0ErXyYKYnBXdxT9V0mN8tMqaN18drzSH9-CWyLONht1rPsceAi3Z-PUDR4-UMTcm205nDc9iXis Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 93539ede044a41b696986aaf5b86da65 Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:08.896024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93539ede044a41b696986aaf5b86da65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93539ede044a41b696986aaf5b86da65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93539ede044a41b696986aaf5b86da65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93539ede044a41b696986aaf5b86da65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 93539ede044a41b696986aaf5b86da65 Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotsTestJSON-1037903590-project Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 253aa2f7704e48b59ce4cf39d6ab50ca Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1037903590-project Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '25317b8f-3d03-4898-b416-b3f14a625b3f'} Jul 21 08:32:08.897438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. (HTTP 404) (Request-ID: req-6e9e8d0f-ae12-4d26-9021-ad59f201a017) Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:08.898599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:32:08.899838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 08:32:08.906170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.907608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.910724 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf4a7d30-bcdf-4fd9-b582-92b4ca8d7c71 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:08.910724 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf4a7d30-bcdf-4fd9-b582-92b4ca8d7c71 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:08.912398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf4a7d30-bcdf-4fd9-b582-92b4ca8d7c71 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:08.913189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf4a7d30-bcdf-4fd9-b582-92b4ca8d7c71 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:08.914894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf4a7d30-bcdf-4fd9-b582-92b4ca8d7c71 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:08.916193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf4a7d30-bcdf-4fd9-b582-92b4ca8d7c71 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:08.922532 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80edb718-3f15-465b-b4e2-9f272b150c3e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Returning 404 to user: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:08.924334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80edb718-3f15-465b-b4e2-9f272b150c3e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 404 len: 109 microversion: 2.1 time: 0.068805 Jul 21 08:32:08.924915 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 121/239] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:32:08 2022] GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:32:08.937886 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1c3911e-47e1-4eba-bd91-21a00117809e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bcebe310>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:08.985712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-a1c3911e-47e1-4eba-bd91-21a00117809e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] HTTP exception thrown: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1c3911e-47e1-4eba-bd91-21a00117809e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Request method failure captured: Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f HTTP/1.1 Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q792BjlpHIENbRdVnEWh6XjKbEenMDrlDPpgP9_ZB031lwTQrFIgQyWMLeDJCv5pzcc48wwH0wM2pqTvLobTDfwJ_wWPEoDQikj0ErXyYKYnBXdxT9V0mN8tMqaN18drzSH9-CWyLONht1rPsceAi3Z-PUDR4-UMTcm205nDc9iXis Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 93539ede044a41b696986aaf5b86da65 Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:08.988685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93539ede044a41b696986aaf5b86da65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93539ede044a41b696986aaf5b86da65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93539ede044a41b696986aaf5b86da65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93539ede044a41b696986aaf5b86da65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 93539ede044a41b696986aaf5b86da65 Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotsTestJSON-1037903590-project Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 253aa2f7704e48b59ce4cf39d6ab50ca Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1037903590-project Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '25317b8f-3d03-4898-b416-b3f14a625b3f'} Jul 21 08:32:08.990217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. (HTTP 404) (Request-ID: req-63b69d80-3d60-40f0-824f-fe30cb3a480d) Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:08.991271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 08:32:08.993293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 08:32:08.996098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:08.997368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:09.000832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1c3911e-47e1-4eba-bd91-21a00117809e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Returning 404 to user: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:09.000832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a1c3911e-47e1-4eba-bd91-21a00117809e tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 404 len: 109 microversion: 2.1 time: 0.068382 Jul 21 08:32:09.000832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 122/240] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:32:08 2022] DELETE /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:32:09.009642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a46f94c-ed68-468f-8f34-7ae13857ea69 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Calling method '.version_select at 0x7f65bcee89d0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:09.048483 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-1a46f94c-ed68-468f-8f34-7ae13857ea69 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] HTTP exception thrown: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a46f94c-ed68-468f-8f34-7ae13857ea69 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Request method failure captured: Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f HTTP/1.1 Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q792BjlpHIENbRdVnEWh6XjKbEenMDrlDPpgP9_ZB031lwTQrFIgQyWMLeDJCv5pzcc48wwH0wM2pqTvLobTDfwJ_wWPEoDQikj0ErXyYKYnBXdxT9V0mN8tMqaN18drzSH9-CWyLONht1rPsceAi3Z-PUDR4-UMTcm205nDc9iXis Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 93539ede044a41b696986aaf5b86da65 Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:09.050824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93539ede044a41b696986aaf5b86da65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93539ede044a41b696986aaf5b86da65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93539ede044a41b696986aaf5b86da65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93539ede044a41b696986aaf5b86da65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 93539ede044a41b696986aaf5b86da65 Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1037903590 Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotsTestJSON-1037903590-project Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 253aa2f7704e48b59ce4cf39d6ab50ca Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1037903590-project Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '25317b8f-3d03-4898-b416-b3f14a625b3f'} Jul 21 08:32:09.052277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. (HTTP 404) (Request-ID: req-5cb37ebf-77a7-43bc-99ad-ad58167ea9bd) Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:09.053045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:32:09.054080 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 08:32:09.055658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a46f94c-ed68-468f-8f34-7ae13857ea69 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] Returning 404 to user: Volume 25317b8f-3d03-4898-b416-b3f14a625b3f could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a46f94c-ed68-468f-8f34-7ae13857ea69 tempest-VolumesSnapshotsTestJSON-1037903590 tempest-VolumesSnapshotsTestJSON-1037903590-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f" status: 404 len: 109 microversion: 2.1 time: 0.047135 Jul 21 08:32:09.059135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 123/241] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:32:09 2022] GET /compute/v2.1/os-volumes/25317b8f-3d03-4898-b416-b3f14a625b3f => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:32:09.189710 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cf4a7d30-bcdf-4fd9-b582-92b4ca8d7c71 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:09.200027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf4a7d30-bcdf-4fd9-b582-92b4ca8d7c71 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.307244 Jul 21 08:32:09.200749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 119/242] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:08 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:09.692851 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f2b97b18-ab1e-414a-874a-edd84525e0ee tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:09.693459 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f2b97b18-ab1e-414a-874a-edd84525e0ee tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:09.700497 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2b97b18-ab1e-414a-874a-edd84525e0ee tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:09.701265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2b97b18-ab1e-414a-874a-edd84525e0ee tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:09.702930 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2b97b18-ab1e-414a-874a-edd84525e0ee tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:09.703667 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2b97b18-ab1e-414a-874a-edd84525e0ee tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:09.710069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:09.893119 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f2b97b18-ab1e-414a-874a-edd84525e0ee tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:09.904337 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f2b97b18-ab1e-414a-874a-edd84525e0ee tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.215696 Jul 21 08:32:09.905144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 124/243] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:09 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:10.219262 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d6b2b8b-0d90-4df1-b54f-cc27041847ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:10.220609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d6b2b8b-0d90-4df1-b54f-cc27041847ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:10.226995 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d6b2b8b-0d90-4df1-b54f-cc27041847ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:10.227779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d6b2b8b-0d90-4df1-b54f-cc27041847ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:10.229297 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d6b2b8b-0d90-4df1-b54f-cc27041847ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:10.230099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d6b2b8b-0d90-4df1-b54f-cc27041847ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:10.414203 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d6b2b8b-0d90-4df1-b54f-cc27041847ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:10.426737 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d6b2b8b-0d90-4df1-b54f-cc27041847ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.211991 Jul 21 08:32:10.438031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 120/244] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:10 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:10.922451 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0756543-9f8f-4328-982a-7e13bf99ff5b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:10.923046 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0756543-9f8f-4328-982a-7e13bf99ff5b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:10.929357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0756543-9f8f-4328-982a-7e13bf99ff5b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:10.929794 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0756543-9f8f-4328-982a-7e13bf99ff5b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:10.930780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0756543-9f8f-4328-982a-7e13bf99ff5b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:10.931383 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0756543-9f8f-4328-982a-7e13bf99ff5b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:10.949886 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:11.024694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-168e8588-6e12-4a84-8260-307893ce141a tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Action: 'create', calling method: .version_select at 0x7f65bcebe4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-127977273", "metadata": {"Type": "work"}}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-168e8588-6e12-4a84-8260-307893ce141a tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Request method failure captured: Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 121 Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q8KeUuYsioFnm_ZwCZJAfJensVsXAxm_EiTvmP9a1C80OKwCIDs9avwxFS6s1VtZVc787Od2kMEt5WqgqU9Wu6xjcIBmpNxD0H6BtsNBlzWZMhrJB3wDxI9uSFxPIv6awj8Jm_xlOVKhtDHtk6T_QwfNU5dBgwyWeMiRPF9gi9RLgM Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:11.055304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: f019747f42954cba836a09b7649c3a91 Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-127977273", "metadata": {"Type": "work"}}} Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:32:11.056795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-127977273', 'metadata': {'Type': 'work'}}}} Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise error Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:11.058093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 08:32:11.059559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 08:32:11.060831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 08:32:11.060831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.060831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-168e8588-6e12-4a84-8260-307893ce141a tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:11.062347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-168e8588-6e12-4a84-8260-307893ce141a tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.165468 Jul 21 08:32:11.063747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 125/245] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Jul 21 08:32:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 08:32:11.075173 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f54efb09-ce76-44f0-ae28-07e1ca6fd8a3 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Action: 'create', calling method: .version_select at 0x7f65bcec3040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-956615476", "metadata": {"Type": "work"}}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f54efb09-ce76-44f0-ae28-07e1ca6fd8a3 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Request method failure captured: Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 119 Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q8KeUuYsioFnm_ZwCZJAfJensVsXAxm_EiTvmP9a1C80OKwCIDs9avwxFS6s1VtZVc787Od2kMEt5WqgqU9Wu6xjcIBmpNxD0H6BtsNBlzWZMhrJB3wDxI9uSFxPIv6awj8Jm_xlOVKhtDHtk6T_QwfNU5dBgwyWeMiRPF9gi9RLgM Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:11.079794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: f019747f42954cba836a09b7649c3a91 Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-956615476", "metadata": {"Type": "work"}}} Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:32:11.081208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-956615476', 'metadata': {'Type': 'work'}}}} Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise error Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi '0' Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:11.082014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 08:32:11.083265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 08:32:11.084289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 08:32:11.084289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.084289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f54efb09-ce76-44f0-ae28-07e1ca6fd8a3 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:11.084289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f54efb09-ce76-44f0-ae28-07e1ca6fd8a3 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012705 Jul 21 08:32:11.084289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 126/246] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Jul 21 08:32:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:32:11.095630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3fc2d5d1-6b4c-4d58-88fa-219d34fb5946 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Action: 'create', calling method: .version_select at 0x7f65bcd45700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-843864237", "metadata": {"Type": "work"}}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3fc2d5d1-6b4c-4d58-88fa-219d34fb5946 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Request method failure captured: Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 118 Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q8KeUuYsioFnm_ZwCZJAfJensVsXAxm_EiTvmP9a1C80OKwCIDs9avwxFS6s1VtZVc787Od2kMEt5WqgqU9Wu6xjcIBmpNxD0H6BtsNBlzWZMhrJB3wDxI9uSFxPIv6awj8Jm_xlOVKhtDHtk6T_QwfNU5dBgwyWeMiRPF9gi9RLgM Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:11.098222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: f019747f42954cba836a09b7649c3a91 Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-843864237", "metadata": {"Type": "work"}}} Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:32:11.099700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-843864237', 'metadata': {'Type': 'work'}}}} Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise error Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi '' Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:11.100475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 08:32:11.101828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 08:32:11.102790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 08:32:11.102790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.102790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3fc2d5d1-6b4c-4d58-88fa-219d34fb5946 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:11.102790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3fc2d5d1-6b4c-4d58-88fa-219d34fb5946 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010180 Jul 21 08:32:11.102790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 127/247] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Jul 21 08:32:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:32:11.113392 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d724c2e5-9717-42fd-b196-b110759f4ee0 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Calling method '.version_select at 0x7f65bcebeca0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:11.124607 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0756543-9f8f-4328-982a-7e13bf99ff5b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:11.132851 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0756543-9f8f-4328-982a-7e13bf99ff5b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.214091 Jul 21 08:32:11.135787 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 121/248] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:10 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:11.145473 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-d724c2e5-9717-42fd-b196-b110759f4ee0 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] HTTP exception thrown: Volume tempest-invalid-1783209387 could not be found. Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d724c2e5-9717-42fd-b196-b110759f4ee0 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Request method failure captured: Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1783209387 HTTP/1.1 Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q8KeUuYsioFnm_ZwCZJAfJensVsXAxm_EiTvmP9a1C80OKwCIDs9avwxFS6s1VtZVc787Od2kMEt5WqgqU9Wu6xjcIBmpNxD0H6BtsNBlzWZMhrJB3wDxI9uSFxPIv6awj8Jm_xlOVKhtDHtk6T_QwfNU5dBgwyWeMiRPF9gi9RLgM Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:11.146862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: f019747f42954cba836a09b7649c3a91 Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Volume tempest-invalid-1783209387 could not be found. Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'tempest-invalid-1783209387'} Jul 21 08:32:11.148359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1783209387 could not be found. (HTTP 404) (Request-ID: req-ff11484b-fee2-4f30-969b-6ca9446cf1c6) Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.149239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 08:32:11.151314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1783209387 could not be found. Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:11.152622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1783209387 could not be found. Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1783209387 could not be found. Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d724c2e5-9717-42fd-b196-b110759f4ee0 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Returning 404 to user: Volume tempest-invalid-1783209387 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d724c2e5-9717-42fd-b196-b110759f4ee0 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1783209387" status: 404 len: 99 microversion: 2.1 time: 0.039386 Jul 21 08:32:11.154208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 128/249] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 21 08:32:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1783209387 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 21 08:32:11.159993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c66dc70-1576-4226-bf78-ec0b0e61b79a tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003824 Jul 21 08:32:11.160490 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 122/250] 10.222.0.47 () {58 vars in 1139 bytes} [Thu Jul 21 08:32:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 08:32:11.170513 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-429f5f79-321a-4729-a7a2-41c8213a84b9 tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005110 Jul 21 08:32:11.171033 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 129/251] 10.222.0.47 () {58 vars in 1136 bytes} [Thu Jul 21 08:32:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 08:32:11.180514 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e4476d22-725b-433c-bb94-368644c5904b tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Calling method '.version_select at 0x7f65bc6c5550>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:11.214881 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-e4476d22-725b-433c-bb94-368644c5904b tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] HTTP exception thrown: Volume c22171c9-b5c4-45d8-963b-ed55ea250e63 could not be found. Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e4476d22-725b-433c-bb94-368644c5904b tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Request method failure captured: Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/os-volumes/c22171c9-b5c4-45d8-963b-ed55ea250e63 HTTP/1.1 Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q8KeUuYsioFnm_ZwCZJAfJensVsXAxm_EiTvmP9a1C80OKwCIDs9avwxFS6s1VtZVc787Od2kMEt5WqgqU9Wu6xjcIBmpNxD0H6BtsNBlzWZMhrJB3wDxI9uSFxPIv6awj8Jm_xlOVKhtDHtk6T_QwfNU5dBgwyWeMiRPF9gi9RLgM Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:32:11.232055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: f019747f42954cba836a09b7649c3a91 Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Volume c22171c9-b5c4-45d8-963b-ed55ea250e63 could not be found. Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'c22171c9-b5c4-45d8-963b-ed55ea250e63'} Jul 21 08:32:11.233939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c22171c9-b5c4-45d8-963b-ed55ea250e63 could not be found. (HTTP 404) (Request-ID: req-49a6986d-8e31-4672-8971-75c8ba89e7b5) Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.234858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 08:32:11.236354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c22171c9-b5c4-45d8-963b-ed55ea250e63 could not be found. Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 08:32:11.237518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c22171c9-b5c4-45d8-963b-ed55ea250e63 could not be found. Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c22171c9-b5c4-45d8-963b-ed55ea250e63 could not be found. Jul 21 08:32:11.238817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.244356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e4476d22-725b-433c-bb94-368644c5904b tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Returning 404 to user: Volume c22171c9-b5c4-45d8-963b-ed55ea250e63 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:11.245605 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e4476d22-725b-433c-bb94-368644c5904b tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/c22171c9-b5c4-45d8-963b-ed55ea250e63" status: 404 len: 109 microversion: 2.1 time: 0.069201 Jul 21 08:32:11.247379 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 123/252] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:32:11 2022] DELETE /compute/v2.1/os-volumes/c22171c9-b5c4-45d8-963b-ed55ea250e63 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:32:11.258905 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91a736bc-4237-41c3-b713-3db00fead03d tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Calling method '.version_select at 0x7f65bce70ca0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:11.303109 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-91a736bc-4237-41c3-b713-3db00fead03d tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] HTTP exception thrown: Volume 3b3666c1-af69-4c5e-a9ca-306924f4b738 could not be found. Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91a736bc-4237-41c3-b713-3db00fead03d tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Request method failure captured: Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/os-volumes/3b3666c1-af69-4c5e-a9ca-306924f4b738 HTTP/1.1 Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q8KeUuYsioFnm_ZwCZJAfJensVsXAxm_EiTvmP9a1C80OKwCIDs9avwxFS6s1VtZVc787Od2kMEt5WqgqU9Wu6xjcIBmpNxD0H6BtsNBlzWZMhrJB3wDxI9uSFxPIv6awj8Jm_xlOVKhtDHtk6T_QwfNU5dBgwyWeMiRPF9gi9RLgM Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:11.305073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b81fcc0271d64d308682d41e453ebe79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: b81fcc0271d64d308682d41e453ebe79 Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesNegativeTest-1366968328 Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: f019747f42954cba836a09b7649c3a91 Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesNegativeTest-1366968328-project Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Volume 3b3666c1-af69-4c5e-a9ca-306924f4b738 could not be found. Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '3b3666c1-af69-4c5e-a9ca-306924f4b738'} Jul 21 08:32:11.306297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b3666c1-af69-4c5e-a9ca-306924f4b738 could not be found. (HTTP 404) (Request-ID: req-e39b914c-0f33-4e65-a111-c54966324050) Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.307084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 08:32:11.308143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b3666c1-af69-4c5e-a9ca-306924f4b738 could not be found. Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 08:32:11.309187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b3666c1-af69-4c5e-a9ca-306924f4b738 could not be found. Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b3666c1-af69-4c5e-a9ca-306924f4b738 could not be found. Jul 21 08:32:11.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:11.312848 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91a736bc-4237-41c3-b713-3db00fead03d tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] Returning 404 to user: Volume 3b3666c1-af69-4c5e-a9ca-306924f4b738 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:11.313710 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-91a736bc-4237-41c3-b713-3db00fead03d tempest-VolumesNegativeTest-1366968328 tempest-VolumesNegativeTest-1366968328-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3b3666c1-af69-4c5e-a9ca-306924f4b738" status: 404 len: 109 microversion: 2.1 time: 0.059474 Jul 21 08:32:11.314279 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 130/253] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:32:11 2022] GET /compute/v2.1/os-volumes/3b3666c1-af69-4c5e-a9ca-306924f4b738 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:32:11.444593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f9f26fc6-aee4-48f6-9661-0394dc23a59c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:11.445470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f9f26fc6-aee4-48f6-9661-0394dc23a59c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:11.460489 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9f26fc6-aee4-48f6-9661-0394dc23a59c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:11.461379 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9f26fc6-aee4-48f6-9661-0394dc23a59c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:11.462679 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9f26fc6-aee4-48f6-9661-0394dc23a59c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:11.463436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9f26fc6-aee4-48f6-9661-0394dc23a59c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:11.627886 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f9f26fc6-aee4-48f6-9661-0394dc23a59c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:11.635729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f9f26fc6-aee4-48f6-9661-0394dc23a59c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.195396 Jul 21 08:32:11.636400 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 124/254] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:11 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:12.153894 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5277ce0d-c874-4f12-8e91-473caa30c122 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:12.154578 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5277ce0d-c874-4f12-8e91-473caa30c122 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:12.170770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5277ce0d-c874-4f12-8e91-473caa30c122 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:12.171976 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5277ce0d-c874-4f12-8e91-473caa30c122 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:12.173002 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5277ce0d-c874-4f12-8e91-473caa30c122 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:12.174883 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5277ce0d-c874-4f12-8e91-473caa30c122 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:12.426584 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5277ce0d-c874-4f12-8e91-473caa30c122 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:12.446224 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5277ce0d-c874-4f12-8e91-473caa30c122 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1523 microversion: 2.1 time: 0.296680 Jul 21 08:32:12.451032 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 131/255] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:12 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:12.653651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4412e06d-e7b7-4263-9e2e-eafa7b27b2a1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:12.654480 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4412e06d-e7b7-4263-9e2e-eafa7b27b2a1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:12.661777 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4412e06d-e7b7-4263-9e2e-eafa7b27b2a1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:12.662344 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4412e06d-e7b7-4263-9e2e-eafa7b27b2a1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:12.663357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4412e06d-e7b7-4263-9e2e-eafa7b27b2a1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:12.664919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4412e06d-e7b7-4263-9e2e-eafa7b27b2a1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:12.839210 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4412e06d-e7b7-4263-9e2e-eafa7b27b2a1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:12.850279 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4412e06d-e7b7-4263-9e2e-eafa7b27b2a1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.201666 Jul 21 08:32:12.851276 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 125/256] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:12 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:13.346321 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-7b2f2347-4014-4c13-9718-2987c676ecad req-088a80a0-3734-4c6f-b181-64702ad133cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579", "name": "network-vif-plugged", "status": "completed", "tag": "227fda77-0d6a-4a0d-98e1-1530004438e6"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:13.355315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-7b2f2347-4014-4c13-9718-2987c676ecad req-088a80a0-3734-4c6f-b181-64702ad133cf service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:13.355781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-7b2f2347-4014-4c13-9718-2987c676ecad req-088a80a0-3734-4c6f-b181-64702ad133cf service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:13.368346 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-7b2f2347-4014-4c13-9718-2987c676ecad req-088a80a0-3734-4c6f-b181-64702ad133cf service nova] Creating event network-vif-plugged:227fda77-0d6a-4a0d-98e1-1530004438e6 for instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 on hv-cinder-85032 Jul 21 08:32:13.373951 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-7b2f2347-4014-4c13-9718-2987c676ecad req-088a80a0-3734-4c6f-b181-64702ad133cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031623 Jul 21 08:32:13.374559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 132/257] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:13.467417 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11b10dfb-cde4-4819-8e0d-10f4b8a6a901 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:13.468103 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-11b10dfb-cde4-4819-8e0d-10f4b8a6a901 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:13.479667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b10dfb-cde4-4819-8e0d-10f4b8a6a901 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:13.480388 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b10dfb-cde4-4819-8e0d-10f4b8a6a901 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:13.481367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b10dfb-cde4-4819-8e0d-10f4b8a6a901 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:13.486297 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b10dfb-cde4-4819-8e0d-10f4b8a6a901 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:13.660697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-11b10dfb-cde4-4819-8e0d-10f4b8a6a901 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:13.670683 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-11b10dfb-cde4-4819-8e0d-10f4b8a6a901 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1503 microversion: 2.1 time: 0.207144 Jul 21 08:32:13.671272 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 126/258] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:13 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:13.691075 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca269858-e606-45eb-82ee-df760a00634a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:13.691909 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ca269858-e606-45eb-82ee-df760a00634a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:13.699350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca269858-e606-45eb-82ee-df760a00634a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:13.699817 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca269858-e606-45eb-82ee-df760a00634a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:13.700691 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca269858-e606-45eb-82ee-df760a00634a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:13.701132 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca269858-e606-45eb-82ee-df760a00634a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:13.857460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca269858-e606-45eb-82ee-df760a00634a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:13.866351 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ca269858-e606-45eb-82ee-df760a00634a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1515 microversion: 2.1 time: 0.180309 Jul 21 08:32:13.867227 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 133/259] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:13 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:13.887591 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce28885c-344f-4372-95a1-0a976965c176 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:13.887591 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce28885c-344f-4372-95a1-0a976965c176 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:13.893898 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce28885c-344f-4372-95a1-0a976965c176 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:13.894194 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce28885c-344f-4372-95a1-0a976965c176 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:13.894999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce28885c-344f-4372-95a1-0a976965c176 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:13.895459 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce28885c-344f-4372-95a1-0a976965c176 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:14.076697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ce28885c-344f-4372-95a1-0a976965c176 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:14.084584 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce28885c-344f-4372-95a1-0a976965c176 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.220638 Jul 21 08:32:14.085498 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 127/260] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:13 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:14.614563 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8bf451b9-bffb-43d1-8ace-3349b8b0b1eb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a08887d-a709-4c20-996c-5c0d0228fe8a", "device": "/dev/sdb"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:14.620481 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8bf451b9-bffb-43d1-8ace-3349b8b0b1eb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:14.638044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bf451b9-bffb-43d1-8ace-3349b8b0b1eb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:14.653751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bf451b9-bffb-43d1-8ace-3349b8b0b1eb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:14.653751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bf451b9-bffb-43d1-8ace-3349b8b0b1eb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:14.653751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bf451b9-bffb-43d1-8ace-3349b8b0b1eb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:15.102578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f57e804c-ae79-484c-8f73-118e0f84c8b4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:15.103945 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f57e804c-ae79-484c-8f73-118e0f84c8b4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:15.110323 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f57e804c-ae79-484c-8f73-118e0f84c8b4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:15.110788 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f57e804c-ae79-484c-8f73-118e0f84c8b4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:15.116334 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f57e804c-ae79-484c-8f73-118e0f84c8b4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:15.122560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f57e804c-ae79-484c-8f73-118e0f84c8b4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:15.214649 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8bf451b9-bffb-43d1-8ace-3349b8b0b1eb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "POST /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602754 Jul 21 08:32:15.215774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 134/261] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:32:14 2022] POST /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:32:15.315870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f57e804c-ae79-484c-8f73-118e0f84c8b4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:15.325423 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f57e804c-ae79-484c-8f73-118e0f84c8b4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1313 microversion: 2.1 time: 0.227252 Jul 21 08:32:15.331382 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 128/262] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:15 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:15.487879 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb10404b-24e6-4bad-8d81-9f07ebcafc72 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:15.487879 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cb10404b-24e6-4bad-8d81-9f07ebcafc72 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:15.504685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb10404b-24e6-4bad-8d81-9f07ebcafc72 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:15.505411 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb10404b-24e6-4bad-8d81-9f07ebcafc72 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:15.506589 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb10404b-24e6-4bad-8d81-9f07ebcafc72 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:15.507453 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb10404b-24e6-4bad-8d81-9f07ebcafc72 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:15.547984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-cb10404b-24e6-4bad-8d81-9f07ebcafc72 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lazy-loading 'flavor' on Instance uuid a142cdd4-307c-476e-a178-54914626cda0 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:32:15.696428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cb10404b-24e6-4bad-8d81-9f07ebcafc72 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0/action" status: 200 len: 32 microversion: 2.1 time: 0.215104 Jul 21 08:32:15.701149 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 135/263] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:32:15 2022] POST /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:32:15.712119 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51ac2dbc-824e-403e-983e-d9489c23c0cf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:15.712985 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51ac2dbc-824e-403e-983e-d9489c23c0cf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:15.730235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51ac2dbc-824e-403e-983e-d9489c23c0cf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:15.730685 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51ac2dbc-824e-403e-983e-d9489c23c0cf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:15.735514 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51ac2dbc-824e-403e-983e-d9489c23c0cf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:15.736237 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51ac2dbc-824e-403e-983e-d9489c23c0cf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:16.072528 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51ac2dbc-824e-403e-983e-d9489c23c0cf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:16.082740 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51ac2dbc-824e-403e-983e-d9489c23c0cf tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.379556 Jul 21 08:32:16.090457 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 129/264] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:15 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:16.343215 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb2eb295-fcd8-4535-bf4f-44270f4f1122 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:16.344206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cb2eb295-fcd8-4535-bf4f-44270f4f1122 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:16.354366 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb2eb295-fcd8-4535-bf4f-44270f4f1122 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:16.355113 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb2eb295-fcd8-4535-bf4f-44270f4f1122 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:16.356375 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb2eb295-fcd8-4535-bf4f-44270f4f1122 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:16.356968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb2eb295-fcd8-4535-bf4f-44270f4f1122 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:16.660536 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cb2eb295-fcd8-4535-bf4f-44270f4f1122 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:16.670266 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cb2eb295-fcd8-4535-bf4f-44270f4f1122 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1498 microversion: 2.1 time: 0.331186 Jul 21 08:32:16.671250 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 136/265] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:16 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:17.108025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-34e4e196-3620-441d-8a5e-5576d6cb9ef5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:17.109423 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-34e4e196-3620-441d-8a5e-5576d6cb9ef5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:17.116913 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34e4e196-3620-441d-8a5e-5576d6cb9ef5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:17.117898 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34e4e196-3620-441d-8a5e-5576d6cb9ef5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:17.119017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34e4e196-3620-441d-8a5e-5576d6cb9ef5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:17.120199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34e4e196-3620-441d-8a5e-5576d6cb9ef5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:17.310114 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34e4e196-3620-441d-8a5e-5576d6cb9ef5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:17.310114 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-34e4e196-3620-441d-8a5e-5576d6cb9ef5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.203731 Jul 21 08:32:17.316698 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 130/266] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:17 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:17.370246 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0ad6f50b-2855-4b3a-961e-918c0bbb870d tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:17.370819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0ad6f50b-2855-4b3a-961e-918c0bbb870d tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:17.378658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=48 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:17.381009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ad6f50b-2855-4b3a-961e-918c0bbb870d tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:17.381751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ad6f50b-2855-4b3a-961e-918c0bbb870d tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:17.382820 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ad6f50b-2855-4b3a-961e-918c0bbb870d tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:17.383262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ad6f50b-2855-4b3a-961e-918c0bbb870d tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:17.414907 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0ad6f50b-2855-4b3a-961e-918c0bbb870d tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:32:17.529631 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0ad6f50b-2855-4b3a-961e-918c0bbb870d tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 204 len: 0 microversion: 2.1 time: 0.164226 Jul 21 08:32:17.532102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 137/267] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:32:17 2022] DELETE /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:32:17.542416 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae2ae813-5aaf-4111-86c7-d8afbf8903c6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:17.543022 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae2ae813-5aaf-4111-86c7-d8afbf8903c6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:17.555681 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae2ae813-5aaf-4111-86c7-d8afbf8903c6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:17.556007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae2ae813-5aaf-4111-86c7-d8afbf8903c6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:17.556834 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae2ae813-5aaf-4111-86c7-d8afbf8903c6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:17.557280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae2ae813-5aaf-4111-86c7-d8afbf8903c6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:17.703113 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae2ae813-5aaf-4111-86c7-d8afbf8903c6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:17.711370 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae2ae813-5aaf-4111-86c7-d8afbf8903c6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1504 microversion: 2.1 time: 0.174912 Jul 21 08:32:17.712328 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 131/268] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:17 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:18.324502 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2c6c39f0-d4cd-4807-97ed-2d983387f593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:18.325244 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2c6c39f0-d4cd-4807-97ed-2d983387f593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:18.331811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2c6c39f0-d4cd-4807-97ed-2d983387f593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:18.332305 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2c6c39f0-d4cd-4807-97ed-2d983387f593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:18.333291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2c6c39f0-d4cd-4807-97ed-2d983387f593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:18.333786 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2c6c39f0-d4cd-4807-97ed-2d983387f593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:18.481978 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2c6c39f0-d4cd-4807-97ed-2d983387f593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:18.491089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2c6c39f0-d4cd-4807-97ed-2d983387f593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.170859 Jul 21 08:32:18.493188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 138/269] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:18 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:18.730710 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f74d511-3c4a-47d9-b7cf-b76585168087 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:18.731541 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f74d511-3c4a-47d9-b7cf-b76585168087 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:18.737944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f74d511-3c4a-47d9-b7cf-b76585168087 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:18.738576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f74d511-3c4a-47d9-b7cf-b76585168087 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:18.739457 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f74d511-3c4a-47d9-b7cf-b76585168087 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:18.739901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f74d511-3c4a-47d9-b7cf-b76585168087 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:18.901226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f74d511-3c4a-47d9-b7cf-b76585168087 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:18.912048 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f74d511-3c4a-47d9-b7cf-b76585168087 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1504 microversion: 2.1 time: 0.185741 Jul 21 08:32:18.912621 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 132/270] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:18 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:19.509474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d04fed70-dada-4d8c-ad15-58e23f4fec02 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:19.510729 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d04fed70-dada-4d8c-ad15-58e23f4fec02 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:19.519909 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d04fed70-dada-4d8c-ad15-58e23f4fec02 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:19.520347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d04fed70-dada-4d8c-ad15-58e23f4fec02 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:19.521125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d04fed70-dada-4d8c-ad15-58e23f4fec02 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:19.521556 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d04fed70-dada-4d8c-ad15-58e23f4fec02 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:19.932964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8dbc351e-91b5-4f02-8406-7ef910e0919e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:19.934212 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8dbc351e-91b5-4f02-8406-7ef910e0919e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:19.940773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dbc351e-91b5-4f02-8406-7ef910e0919e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:19.941490 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dbc351e-91b5-4f02-8406-7ef910e0919e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:19.942430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dbc351e-91b5-4f02-8406-7ef910e0919e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:19.943017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dbc351e-91b5-4f02-8406-7ef910e0919e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:20.062906 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d04fed70-dada-4d8c-ad15-58e23f4fec02 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:20.072493 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d04fed70-dada-4d8c-ad15-58e23f4fec02 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.566352 Jul 21 08:32:20.082210 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 139/271] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:19 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:20.261862 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8dbc351e-91b5-4f02-8406-7ef910e0919e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:20.271074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8dbc351e-91b5-4f02-8406-7ef910e0919e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 200 len: 1504 microversion: 2.1 time: 0.341579 Jul 21 08:32:20.271303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 133/272] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:19 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:20.410241 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-5a53797a-3ae2-4155-94c4-e5cb07a8812c req-ea695539-8d9e-4aa9-b85d-bcf9ff809e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579", "name": "network-vif-deleted", "tag": "227fda77-0d6a-4a0d-98e1-1530004438e6"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:20.428947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-5a53797a-3ae2-4155-94c4-e5cb07a8812c req-ea695539-8d9e-4aa9-b85d-bcf9ff809e02 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:20.429445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-5a53797a-3ae2-4155-94c4-e5cb07a8812c req-ea695539-8d9e-4aa9-b85d-bcf9ff809e02 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:20.443346 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-5a53797a-3ae2-4155-94c4-e5cb07a8812c req-ea695539-8d9e-4aa9-b85d-bcf9ff809e02 service nova] Creating event network-vif-deleted:227fda77-0d6a-4a0d-98e1-1530004438e6 for instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 on hv-cinder-85032 Jul 21 08:32:20.448949 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-5a53797a-3ae2-4155-94c4-e5cb07a8812c req-ea695539-8d9e-4aa9-b85d-bcf9ff809e02 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048743 Jul 21 08:32:20.449556 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 140/273] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:21.091972 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84970c07-583c-4a1c-a173-08809a662f8c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:21.093313 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84970c07-583c-4a1c-a173-08809a662f8c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:21.097043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:21.101587 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84970c07-583c-4a1c-a173-08809a662f8c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:21.102333 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84970c07-583c-4a1c-a173-08809a662f8c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:21.103448 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84970c07-583c-4a1c-a173-08809a662f8c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:21.104071 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84970c07-583c-4a1c-a173-08809a662f8c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:21.288790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:21.289596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:21.297194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:21.297637 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:21.298404 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:21.298829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:21.314276 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] HTTP exception thrown: Instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 could not be found. Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Request method failure captured: Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 HTTP/1.1 Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q77qlG1ajv6xNuM7xi9cdqngxKPwxLuPNS5nn7cYgxc1_uB_8usu-RM1ieMKst41SEXM57ooscMv8KS8G6NGV9IkU2TFxpsHogGXMeOFCaC19r8N6zUVKKv5ISBdsZmksY8F9cSQZxQyE69VacylIOWUtgNO8L8D5BJtw16yMcWqaA Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 6c163cbb79544869bb823308163a4142 Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesActionsTest-1285320438 Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:21.316161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c163cbb79544869bb823308163a4142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c163cbb79544869bb823308163a4142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c163cbb79544869bb823308163a4142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c163cbb79544869bb823308163a4142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesActionsTest-1285320438 Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 6c163cbb79544869bb823308163a4142 Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesActionsTest-1285320438 Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesActionsTest-1285320438-project Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: aa156584880d4449bd89a7bcdcfe403f Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesActionsTest-1285320438-project Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 could not be found. Jul 21 08:32:21.317544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579'} Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 could not be found. Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:21.318247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 could not be found. Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 could not be found. Jul 21 08:32:21.319347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:21.322505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Returning 404 to user: Instance 5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:21.325014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5f4fc1a7-80d7-4e25-8964-97ba1ade5b33 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579" status: 404 len: 111 microversion: 2.1 time: 0.040194 Jul 21 08:32:21.337403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 141/274] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:21 2022] GET /compute/v2.1/servers/5b1db4f8-c7c3-4a5d-bb62-c43f06bf9579 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:32:21.347375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84970c07-583c-4a1c-a173-08809a662f8c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:21.362340 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84970c07-583c-4a1c-a173-08809a662f8c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.276790 Jul 21 08:32:21.366321 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 134/275] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:21 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:21.528963 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2032455111", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "networks": [{"uuid": "4bc2d983-362e-470f-80f5-bbc798d9d507"}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:21.589364 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] validate_networks() for [('4bc2d983-362e-470f-80f5-bbc798d9d507', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:32:22.316959 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:32:22.318226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:32:22.318865 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:32:22.319526 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:32:22.320352 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:32:22.335957 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:22.336609 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:22.337631 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:22.338474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:22.356884 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Getting quotas for project 6c163cbb79544869bb823308163a4142. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:32:22.361254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Getting quotas for user aa156584880d4449bd89a7bcdcfe403f and project 6c163cbb79544869bb823308163a4142. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:32:22.374084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:32:22.376964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:32:22.385761 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-651a889d-22ac-4135-bd7d-93a5f77f2418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:22.387045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-651a889d-22ac-4135-bd7d-93a5f77f2418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:22.395665 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-651a889d-22ac-4135-bd7d-93a5f77f2418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:22.402734 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-651a889d-22ac-4135-bd7d-93a5f77f2418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:22.404149 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-651a889d-22ac-4135-bd7d-93a5f77f2418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:22.404746 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-651a889d-22ac-4135-bd7d-93a5f77f2418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:22.475508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6caabf3c-d793-4496-8a86-63fded0ef428 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946270 Jul 21 08:32:22.476714 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 142/276] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:32:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:32:22.504262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c33a128d-44c2-4fb3-be9d-f62812b6442c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:22.507232 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c33a128d-44c2-4fb3-be9d-f62812b6442c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:22.656962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c33a128d-44c2-4fb3-be9d-f62812b6442c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:22.669736 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c33a128d-44c2-4fb3-be9d-f62812b6442c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1214 microversion: 2.1 time: 0.179447 Jul 21 08:32:22.671485 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 143/277] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:22 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:22.788418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-651a889d-22ac-4135-bd7d-93a5f77f2418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:22.798421 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-651a889d-22ac-4135-bd7d-93a5f77f2418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.416379 Jul 21 08:32:22.799629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 135/278] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:22 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:23.690792 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1995b8a5-4235-4dc5-9eb6-7b8b05c7c84f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:23.691460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1995b8a5-4235-4dc5-9eb6-7b8b05c7c84f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:23.700872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1995b8a5-4235-4dc5-9eb6-7b8b05c7c84f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:23.700872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1995b8a5-4235-4dc5-9eb6-7b8b05c7c84f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:23.700872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1995b8a5-4235-4dc5-9eb6-7b8b05c7c84f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:23.700872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1995b8a5-4235-4dc5-9eb6-7b8b05c7c84f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:23.804467 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1995b8a5-4235-4dc5-9eb6-7b8b05c7c84f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:23.816518 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1995b8a5-4235-4dc5-9eb6-7b8b05c7c84f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1266 microversion: 2.1 time: 0.130117 Jul 21 08:32:23.817577 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 144/279] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:23 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:23.820756 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd33b3c0-87d9-448f-a8ff-e57edd5a39cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:23.822243 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd33b3c0-87d9-448f-a8ff-e57edd5a39cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:23.829114 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd33b3c0-87d9-448f-a8ff-e57edd5a39cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:23.829935 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd33b3c0-87d9-448f-a8ff-e57edd5a39cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:23.831058 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd33b3c0-87d9-448f-a8ff-e57edd5a39cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:23.831928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd33b3c0-87d9-448f-a8ff-e57edd5a39cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:24.060477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd33b3c0-87d9-448f-a8ff-e57edd5a39cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:24.069093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd33b3c0-87d9-448f-a8ff-e57edd5a39cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.254608 Jul 21 08:32:24.072455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 136/280] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:23 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:24.834537 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-157de4b9-c240-4b97-a9db-ae4004e4dbeb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:24.835159 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-157de4b9-c240-4b97-a9db-ae4004e4dbeb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:24.842089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-157de4b9-c240-4b97-a9db-ae4004e4dbeb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:24.842824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-157de4b9-c240-4b97-a9db-ae4004e4dbeb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:24.844365 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-157de4b9-c240-4b97-a9db-ae4004e4dbeb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:24.845062 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-157de4b9-c240-4b97-a9db-ae4004e4dbeb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:24.869757 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:25.089278 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e0c686b-0e5a-4f7e-a9ec-504a555fbed2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:25.090673 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e0c686b-0e5a-4f7e-a9ec-504a555fbed2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:25.098075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e0c686b-0e5a-4f7e-a9ec-504a555fbed2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:25.098767 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e0c686b-0e5a-4f7e-a9ec-504a555fbed2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:25.099915 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e0c686b-0e5a-4f7e-a9ec-504a555fbed2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:25.100651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e0c686b-0e5a-4f7e-a9ec-504a555fbed2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:25.125696 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-157de4b9-c240-4b97-a9db-ae4004e4dbeb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:25.138337 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-157de4b9-c240-4b97-a9db-ae4004e4dbeb tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.308230 Jul 21 08:32:25.138919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 145/281] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:24 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:25.287190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1e0c686b-0e5a-4f7e-a9ec-504a555fbed2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:25.295146 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e0c686b-0e5a-4f7e-a9ec-504a555fbed2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.210369 Jul 21 08:32:25.298110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 137/282] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:25 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:25.533609 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-80fc278f-6fd6-4ea7-93c7-f561451d7d30 req-5228dcf4-a5aa-4e7c-a86b-0c0da2ab3a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7cf7ee4-1677-4bdd-9cf1-879a34e41929", "tag": "22d97224-e481-48a3-864e-fc525c352bb2"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:25.542505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-80fc278f-6fd6-4ea7-93c7-f561451d7d30 req-5228dcf4-a5aa-4e7c-a86b-0c0da2ab3a95 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:25.542942 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-80fc278f-6fd6-4ea7-93c7-f561451d7d30 req-5228dcf4-a5aa-4e7c-a86b-0c0da2ab3a95 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:25.555763 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-80fc278f-6fd6-4ea7-93c7-f561451d7d30 req-5228dcf4-a5aa-4e7c-a86b-0c0da2ab3a95 service nova] Creating event network-changed:22d97224-e481-48a3-864e-fc525c352bb2 for instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 on hv-cinder-85032 Jul 21 08:32:25.560491 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-80fc278f-6fd6-4ea7-93c7-f561451d7d30 req-5228dcf4-a5aa-4e7c-a86b-0c0da2ab3a95 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030671 Jul 21 08:32:25.561071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 146/283] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:26.156108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e3ca870-6362-4b42-b2be-ffb5a9a62b83 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:26.156723 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e3ca870-6362-4b42-b2be-ffb5a9a62b83 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:26.162754 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e3ca870-6362-4b42-b2be-ffb5a9a62b83 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:26.163197 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e3ca870-6362-4b42-b2be-ffb5a9a62b83 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:26.163995 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e3ca870-6362-4b42-b2be-ffb5a9a62b83 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:26.164430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e3ca870-6362-4b42-b2be-ffb5a9a62b83 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:26.299274 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e3ca870-6362-4b42-b2be-ffb5a9a62b83 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:26.307036 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e3ca870-6362-4b42-b2be-ffb5a9a62b83 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.154800 Jul 21 08:32:26.307642 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 138/284] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:26 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:26.315770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6e68718a-0610-4725-b405-385f2d9b4f99 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:26.317069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6e68718a-0610-4725-b405-385f2d9b4f99 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:26.323943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e68718a-0610-4725-b405-385f2d9b4f99 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:26.324506 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e68718a-0610-4725-b405-385f2d9b4f99 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:26.325137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e68718a-0610-4725-b405-385f2d9b4f99 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:26.325562 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e68718a-0610-4725-b405-385f2d9b4f99 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:26.456773 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6e68718a-0610-4725-b405-385f2d9b4f99 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:26.464156 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6e68718a-0610-4725-b405-385f2d9b4f99 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.153178 Jul 21 08:32:26.464724 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 147/285] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:26 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:27.325007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb2c7a08-56ba-43e2-9038-e693cf6466e3 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:27.325586 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bb2c7a08-56ba-43e2-9038-e693cf6466e3 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:27.331986 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb2c7a08-56ba-43e2-9038-e693cf6466e3 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:27.332432 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb2c7a08-56ba-43e2-9038-e693cf6466e3 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:27.333198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb2c7a08-56ba-43e2-9038-e693cf6466e3 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:27.333622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb2c7a08-56ba-43e2-9038-e693cf6466e3 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:27.472761 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bb2c7a08-56ba-43e2-9038-e693cf6466e3 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:27.482108 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bdcb24a3-e018-43dd-aeba-5181cb22afb4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:27.482725 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bdcb24a3-e018-43dd-aeba-5181cb22afb4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:27.490225 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdcb24a3-e018-43dd-aeba-5181cb22afb4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:27.490752 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdcb24a3-e018-43dd-aeba-5181cb22afb4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:27.490940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bb2c7a08-56ba-43e2-9038-e693cf6466e3 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.170591 Jul 21 08:32:27.491541 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 139/286] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:27 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:27.491722 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdcb24a3-e018-43dd-aeba-5181cb22afb4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:27.492211 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdcb24a3-e018-43dd-aeba-5181cb22afb4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:27.707776 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bdcb24a3-e018-43dd-aeba-5181cb22afb4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:27.715541 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bdcb24a3-e018-43dd-aeba-5181cb22afb4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.237773 Jul 21 08:32:27.716117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 148/287] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:27 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:28.508717 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-434acfda-a1fc-47b3-ada7-f9f3f12353f7 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:28.509968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-434acfda-a1fc-47b3-ada7-f9f3f12353f7 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:28.516491 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-434acfda-a1fc-47b3-ada7-f9f3f12353f7 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:28.517142 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-434acfda-a1fc-47b3-ada7-f9f3f12353f7 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:28.518109 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-434acfda-a1fc-47b3-ada7-f9f3f12353f7 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:28.518536 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-434acfda-a1fc-47b3-ada7-f9f3f12353f7 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:28.522612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:28.685898 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-434acfda-a1fc-47b3-ada7-f9f3f12353f7 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:28.694702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-434acfda-a1fc-47b3-ada7-f9f3f12353f7 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.189729 Jul 21 08:32:28.704590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 140/288] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:28 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:28.734960 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9894496b-f859-4410-918e-690df7c741f6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:28.735420 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9894496b-f859-4410-918e-690df7c741f6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:28.741736 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9894496b-f859-4410-918e-690df7c741f6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:28.742465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9894496b-f859-4410-918e-690df7c741f6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:28.743240 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9894496b-f859-4410-918e-690df7c741f6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:28.744224 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9894496b-f859-4410-918e-690df7c741f6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:28.908362 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9894496b-f859-4410-918e-690df7c741f6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:28.918347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9894496b-f859-4410-918e-690df7c741f6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.189205 Jul 21 08:32:28.918929 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 149/289] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:28 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:29.711929 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-138b328e-7694-4de3-912b-6cb1d23cc487 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:29.713113 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-138b328e-7694-4de3-912b-6cb1d23cc487 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:29.719211 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-138b328e-7694-4de3-912b-6cb1d23cc487 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:29.719687 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-138b328e-7694-4de3-912b-6cb1d23cc487 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:29.720445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-138b328e-7694-4de3-912b-6cb1d23cc487 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:29.720875 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-138b328e-7694-4de3-912b-6cb1d23cc487 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:29.849417 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-138b328e-7694-4de3-912b-6cb1d23cc487 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:29.856745 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-138b328e-7694-4de3-912b-6cb1d23cc487 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.148680 Jul 21 08:32:29.857304 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 141/290] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:29 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:29.935707 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c9dd7639-06e3-4ebf-b71f-e56bb15547aa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:29.936313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c9dd7639-06e3-4ebf-b71f-e56bb15547aa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:29.942774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9dd7639-06e3-4ebf-b71f-e56bb15547aa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:29.943228 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9dd7639-06e3-4ebf-b71f-e56bb15547aa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:29.944022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9dd7639-06e3-4ebf-b71f-e56bb15547aa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:29.944456 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9dd7639-06e3-4ebf-b71f-e56bb15547aa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:30.088071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9dd7639-06e3-4ebf-b71f-e56bb15547aa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:30.096094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c9dd7639-06e3-4ebf-b71f-e56bb15547aa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.164154 Jul 21 08:32:30.096736 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 150/291] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:29 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:30.872925 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b991aa18-3301-4028-af24-d134ccdb3771 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:30.873529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b991aa18-3301-4028-af24-d134ccdb3771 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:30.880208 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b991aa18-3301-4028-af24-d134ccdb3771 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:30.880660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b991aa18-3301-4028-af24-d134ccdb3771 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:30.881429 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b991aa18-3301-4028-af24-d134ccdb3771 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:30.881861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b991aa18-3301-4028-af24-d134ccdb3771 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:31.007792 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b991aa18-3301-4028-af24-d134ccdb3771 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:31.015189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b991aa18-3301-4028-af24-d134ccdb3771 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.146062 Jul 21 08:32:31.015800 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 142/292] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:30 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:31.112908 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bdf788aa-2cac-42a6-b71f-551c6b8f6f8d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:31.113526 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bdf788aa-2cac-42a6-b71f-551c6b8f6f8d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:31.120124 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdf788aa-2cac-42a6-b71f-551c6b8f6f8d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:31.120574 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdf788aa-2cac-42a6-b71f-551c6b8f6f8d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:31.121339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdf788aa-2cac-42a6-b71f-551c6b8f6f8d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:31.121777 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdf788aa-2cac-42a6-b71f-551c6b8f6f8d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:31.248955 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bdf788aa-2cac-42a6-b71f-551c6b8f6f8d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:31.257171 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bdf788aa-2cac-42a6-b71f-551c6b8f6f8d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.148025 Jul 21 08:32:31.257741 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 151/293] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:31 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:32.031345 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb41b83b-ed63-40ab-b2ae-5451b69548f6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:32.031896 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb41b83b-ed63-40ab-b2ae-5451b69548f6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:32.037890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb41b83b-ed63-40ab-b2ae-5451b69548f6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:32.038335 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb41b83b-ed63-40ab-b2ae-5451b69548f6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:32.039090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb41b83b-ed63-40ab-b2ae-5451b69548f6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:32.039557 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb41b83b-ed63-40ab-b2ae-5451b69548f6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:32.174660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb41b83b-ed63-40ab-b2ae-5451b69548f6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:32.182928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb41b83b-ed63-40ab-b2ae-5451b69548f6 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.155548 Jul 21 08:32:32.183527 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 143/294] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:32 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:32.275004 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-101af663-bbd7-48a1-ba5c-3f1f78bca48a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:32.275875 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-101af663-bbd7-48a1-ba5c-3f1f78bca48a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:32.282314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-101af663-bbd7-48a1-ba5c-3f1f78bca48a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:32.282754 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-101af663-bbd7-48a1-ba5c-3f1f78bca48a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:32.283543 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-101af663-bbd7-48a1-ba5c-3f1f78bca48a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:32.283968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-101af663-bbd7-48a1-ba5c-3f1f78bca48a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:32.347112 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:32.418336 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-101af663-bbd7-48a1-ba5c-3f1f78bca48a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:32.425668 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-101af663-bbd7-48a1-ba5c-3f1f78bca48a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.155050 Jul 21 08:32:32.426223 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 152/295] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:32 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:33.099501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f344342-285b-46f9-9543-1af20b9d15aa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:33.099997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f344342-285b-46f9-9543-1af20b9d15aa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:33.106422 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f344342-285b-46f9-9543-1af20b9d15aa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:33.106867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f344342-285b-46f9-9543-1af20b9d15aa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:33.107715 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f344342-285b-46f9-9543-1af20b9d15aa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:33.108072 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f344342-285b-46f9-9543-1af20b9d15aa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:33.135947 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f344342-285b-46f9-9543-1af20b9d15aa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/ips" status: 200 len: 151 microversion: 2.20 time: 0.040203 Jul 21 08:32:33.136838 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 144/296] 10.222.0.47 () {60 vars in 1288 bytes} [Thu Jul 21 08:32:33 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:32:33.203076 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-db42e6f9-7b8e-4218-be3d-4dc5330f5c24 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:33.203076 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-db42e6f9-7b8e-4218-be3d-4dc5330f5c24 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:33.203076 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=8 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:33.209022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db42e6f9-7b8e-4218-be3d-4dc5330f5c24 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:33.209494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db42e6f9-7b8e-4218-be3d-4dc5330f5c24 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:33.210265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db42e6f9-7b8e-4218-be3d-4dc5330f5c24 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:33.210704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db42e6f9-7b8e-4218-be3d-4dc5330f5c24 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:33.357212 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-db42e6f9-7b8e-4218-be3d-4dc5330f5c24 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:33.366071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-db42e6f9-7b8e-4218-be3d-4dc5330f5c24 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.170336 Jul 21 08:32:33.366644 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 153/297] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:33 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:33.441849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f2e0b5ae-6f6e-41ed-b1ce-ab62172b4aed tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:33.442649 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f2e0b5ae-6f6e-41ed-b1ce-ab62172b4aed tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:33.449882 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2e0b5ae-6f6e-41ed-b1ce-ab62172b4aed tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:33.449882 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2e0b5ae-6f6e-41ed-b1ce-ab62172b4aed tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:33.450157 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2e0b5ae-6f6e-41ed-b1ce-ab62172b4aed tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:33.450500 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2e0b5ae-6f6e-41ed-b1ce-ab62172b4aed tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:33.584256 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2e0b5ae-6f6e-41ed-b1ce-ab62172b4aed tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:33.591664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f2e0b5ae-6f6e-41ed-b1ce-ab62172b4aed tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.153596 Jul 21 08:32:33.592241 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 145/298] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:33 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:34.384063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-67f55875-080f-461e-963c-12f18163a38e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:34.384634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-67f55875-080f-461e-963c-12f18163a38e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:34.391130 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67f55875-080f-461e-963c-12f18163a38e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:34.391628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67f55875-080f-461e-963c-12f18163a38e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:34.392395 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67f55875-080f-461e-963c-12f18163a38e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:34.392828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67f55875-080f-461e-963c-12f18163a38e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:34.608857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84cc0c9a-5559-4d75-8612-530550642b39 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:34.609453 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84cc0c9a-5559-4d75-8612-530550642b39 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:34.615719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84cc0c9a-5559-4d75-8612-530550642b39 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:34.616286 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84cc0c9a-5559-4d75-8612-530550642b39 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:34.616915 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84cc0c9a-5559-4d75-8612-530550642b39 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:34.617337 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84cc0c9a-5559-4d75-8612-530550642b39 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:34.755117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-67f55875-080f-461e-963c-12f18163a38e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:34.762624 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-67f55875-080f-461e-963c-12f18163a38e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.382487 Jul 21 08:32:34.763200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 154/299] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:34 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:34.764479 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84cc0c9a-5559-4d75-8612-530550642b39 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:34.771949 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84cc0c9a-5559-4d75-8612-530550642b39 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.166906 Jul 21 08:32:34.772500 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 146/300] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:34 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:35.779290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a111191-ec29-4a32-8125-b27c0936ff0e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:35.779958 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a111191-ec29-4a32-8125-b27c0936ff0e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:35.787623 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a111191-ec29-4a32-8125-b27c0936ff0e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:35.788075 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a111191-ec29-4a32-8125-b27c0936ff0e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:35.788893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a111191-ec29-4a32-8125-b27c0936ff0e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:35.789332 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a111191-ec29-4a32-8125-b27c0936ff0e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:35.791058 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-181e2459-d825-4a6b-a298-c7ec59f5d01e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:35.791702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-181e2459-d825-4a6b-a298-c7ec59f5d01e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:35.797705 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-181e2459-d825-4a6b-a298-c7ec59f5d01e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:35.798150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-181e2459-d825-4a6b-a298-c7ec59f5d01e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:35.798911 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-181e2459-d825-4a6b-a298-c7ec59f5d01e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:35.799408 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-181e2459-d825-4a6b-a298-c7ec59f5d01e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:35.921873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1a111191-ec29-4a32-8125-b27c0936ff0e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:35.929417 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a111191-ec29-4a32-8125-b27c0936ff0e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.153992 Jul 21 08:32:35.929993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 155/301] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:35 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:35.930189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-181e2459-d825-4a6b-a298-c7ec59f5d01e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:35.938220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-181e2459-d825-4a6b-a298-c7ec59f5d01e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.153212 Jul 21 08:32:35.938776 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 147/302] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:35 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:36.946823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7c0ce04d-7ba6-4a97-94b0-085a93a92ff8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:36.947474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7c0ce04d-7ba6-4a97-94b0-085a93a92ff8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:36.954062 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c0ce04d-7ba6-4a97-94b0-085a93a92ff8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:36.954509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c0ce04d-7ba6-4a97-94b0-085a93a92ff8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:36.954791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5bcb87a5-45ed-4ec6-8fbf-b52b1ceeacc5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:36.955272 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c0ce04d-7ba6-4a97-94b0-085a93a92ff8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:36.955431 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5bcb87a5-45ed-4ec6-8fbf-b52b1ceeacc5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:36.955737 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c0ce04d-7ba6-4a97-94b0-085a93a92ff8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:36.961423 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bcb87a5-45ed-4ec6-8fbf-b52b1ceeacc5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:36.961865 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bcb87a5-45ed-4ec6-8fbf-b52b1ceeacc5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:36.962634 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bcb87a5-45ed-4ec6-8fbf-b52b1ceeacc5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:36.963066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5bcb87a5-45ed-4ec6-8fbf-b52b1ceeacc5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:37.094390 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7c0ce04d-7ba6-4a97-94b0-085a93a92ff8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:37.102198 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7c0ce04d-7ba6-4a97-94b0-085a93a92ff8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.159815 Jul 21 08:32:37.102820 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 156/303] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:36 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:37.105002 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5bcb87a5-45ed-4ec6-8fbf-b52b1ceeacc5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:37.112867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5bcb87a5-45ed-4ec6-8fbf-b52b1ceeacc5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.161809 Jul 21 08:32:37.113511 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 148/304] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:36 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:38.118034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-925c67e4-417f-45a7-8d8a-f24d01bdcff0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:38.118548 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-925c67e4-417f-45a7-8d8a-f24d01bdcff0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:38.125152 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-925c67e4-417f-45a7-8d8a-f24d01bdcff0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:38.125593 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-925c67e4-417f-45a7-8d8a-f24d01bdcff0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:38.126362 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-925c67e4-417f-45a7-8d8a-f24d01bdcff0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:38.126804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-925c67e4-417f-45a7-8d8a-f24d01bdcff0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:38.130274 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9b2c6dfd-87b8-4e94-af95-842bf97b244c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:38.130887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9b2c6dfd-87b8-4e94-af95-842bf97b244c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:38.137617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b2c6dfd-87b8-4e94-af95-842bf97b244c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:38.138101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b2c6dfd-87b8-4e94-af95-842bf97b244c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:38.138946 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b2c6dfd-87b8-4e94-af95-842bf97b244c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:38.139401 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b2c6dfd-87b8-4e94-af95-842bf97b244c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:38.266527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-925c67e4-417f-45a7-8d8a-f24d01bdcff0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:38.274579 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-925c67e4-417f-45a7-8d8a-f24d01bdcff0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.160393 Jul 21 08:32:38.275194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 157/305] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:38 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:38.293655 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9b2c6dfd-87b8-4e94-af95-842bf97b244c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:38.302231 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9b2c6dfd-87b8-4e94-af95-842bf97b244c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.175973 Jul 21 08:32:38.302801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 149/306] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:38 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:39.167412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b1dd06f6-9b06-4ca5-8f52-eabcefea99f3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:39.167940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b1dd06f6-9b06-4ca5-8f52-eabcefea99f3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:39.174628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1dd06f6-9b06-4ca5-8f52-eabcefea99f3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:39.175100 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1dd06f6-9b06-4ca5-8f52-eabcefea99f3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:39.175929 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1dd06f6-9b06-4ca5-8f52-eabcefea99f3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:39.176368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1dd06f6-9b06-4ca5-8f52-eabcefea99f3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:39.199307 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-b1dd06f6-9b06-4ca5-8f52-eabcefea99f3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lazy-loading 'flavor' on Instance uuid f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:32:39.291420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ffc084fe-c141-497b-8419-4c1ac01e35ac tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:39.292030 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ffc084fe-c141-497b-8419-4c1ac01e35ac tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:39.298062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffc084fe-c141-497b-8419-4c1ac01e35ac tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:39.298505 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffc084fe-c141-497b-8419-4c1ac01e35ac tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:39.299258 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffc084fe-c141-497b-8419-4c1ac01e35ac tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:39.299713 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffc084fe-c141-497b-8419-4c1ac01e35ac tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:39.440857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ffc084fe-c141-497b-8419-4c1ac01e35ac tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:39.450522 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ffc084fe-c141-497b-8419-4c1ac01e35ac tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.162930 Jul 21 08:32:39.451152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 150/307] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:39 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:39.455915 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-614059e5-59c8-460c-a17e-41c1e6f233f9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:39.456517 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-614059e5-59c8-460c-a17e-41c1e6f233f9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:39.466373 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b1dd06f6-9b06-4ca5-8f52-eabcefea99f3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/action" status: 202 len: 0 microversion: 2.20 time: 0.302675 Jul 21 08:32:39.466588 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-614059e5-59c8-460c-a17e-41c1e6f233f9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:39.467260 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-614059e5-59c8-460c-a17e-41c1e6f233f9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:39.467401 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 158/308] 10.222.0.47 () {62 vars in 1318 bytes} [Thu Jul 21 08:32:39 2022] POST /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:32:39.467898 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-614059e5-59c8-460c-a17e-41c1e6f233f9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:39.468338 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-614059e5-59c8-460c-a17e-41c1e6f233f9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:39.475614 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:39.476313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:39.483523 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:39.483979 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:39.484759 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:39.485193 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:39.614339 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-614059e5-59c8-460c-a17e-41c1e6f233f9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:39.621623 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:39.622783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-614059e5-59c8-460c-a17e-41c1e6f233f9 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.170698 Jul 21 08:32:39.623581 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 151/309] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:39 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:39.629886 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:39.631423 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:39.632592 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d35b18da-a75e-4084-aac4-673decad5840 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.161131 Jul 21 08:32:39.633146 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 159/310] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:39 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:32:40.466985 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d091478-4e56-468a-af0d-d61dd8d855c1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:40.467656 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d091478-4e56-468a-af0d-d61dd8d855c1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:40.473936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d091478-4e56-468a-af0d-d61dd8d855c1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:40.474377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d091478-4e56-468a-af0d-d61dd8d855c1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:40.475135 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d091478-4e56-468a-af0d-d61dd8d855c1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:40.475595 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d091478-4e56-468a-af0d-d61dd8d855c1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:40.608353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d091478-4e56-468a-af0d-d61dd8d855c1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:40.616806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d091478-4e56-468a-af0d-d61dd8d855c1 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.153643 Jul 21 08:32:40.617376 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 152/311] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:40 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:40.640105 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b1a280c8-735e-40ea-b7f4-0c284c8db66e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:40.640713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b1a280c8-735e-40ea-b7f4-0c284c8db66e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:40.647274 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1a280c8-735e-40ea-b7f4-0c284c8db66e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:40.647748 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1a280c8-735e-40ea-b7f4-0c284c8db66e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:40.648504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1a280c8-735e-40ea-b7f4-0c284c8db66e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:40.648937 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1a280c8-735e-40ea-b7f4-0c284c8db66e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:40.650828 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:40.651564 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:40.657546 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:40.657995 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:40.658753 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:40.659185 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:40.782018 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b1a280c8-735e-40ea-b7f4-0c284c8db66e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:40.785629 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:40.791284 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:40.794660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b1a280c8-735e-40ea-b7f4-0c284c8db66e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.158302 Jul 21 08:32:40.795239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 160/312] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:40 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:40.799982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:40.801508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:40.802633 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-048f0919-3e2c-489b-b22b-165849f029e7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.156013 Jul 21 08:32:40.803180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 153/313] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:40 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:32:41.634215 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca106bd3-72ff-4d31-a54f-80754ff7e41e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:41.635248 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ca106bd3-72ff-4d31-a54f-80754ff7e41e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:41.644090 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca106bd3-72ff-4d31-a54f-80754ff7e41e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:41.644668 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca106bd3-72ff-4d31-a54f-80754ff7e41e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:41.645451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca106bd3-72ff-4d31-a54f-80754ff7e41e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:41.645945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca106bd3-72ff-4d31-a54f-80754ff7e41e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:41.746286 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-7bfa1d03-f241-4823-b6b8-fa28824d3942 req-852bcab7-9408-4f38-ad72-10433bb0dace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7cf7ee4-1677-4bdd-9cf1-879a34e41929", "name": "network-vif-plugged", "status": "completed", "tag": "22d97224-e481-48a3-864e-fc525c352bb2"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:41.757259 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-7bfa1d03-f241-4823-b6b8-fa28824d3942 req-852bcab7-9408-4f38-ad72-10433bb0dace service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:41.757847 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-7bfa1d03-f241-4823-b6b8-fa28824d3942 req-852bcab7-9408-4f38-ad72-10433bb0dace service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:41.775728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-7bfa1d03-f241-4823-b6b8-fa28824d3942 req-852bcab7-9408-4f38-ad72-10433bb0dace service nova] Creating event network-vif-plugged:22d97224-e481-48a3-864e-fc525c352bb2 for instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 on hv-cinder-85032 Jul 21 08:32:41.782351 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-7bfa1d03-f241-4823-b6b8-fa28824d3942 req-852bcab7-9408-4f38-ad72-10433bb0dace service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040502 Jul 21 08:32:41.783692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 154/314] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:32:41.795654 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca106bd3-72ff-4d31-a54f-80754ff7e41e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:41.803255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ca106bd3-72ff-4d31-a54f-80754ff7e41e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.172941 Jul 21 08:32:41.803969 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 161/315] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:41 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:41.818277 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-904b1cfc-6d7d-41cc-ad38-fdbb86807593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:41.818981 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-904b1cfc-6d7d-41cc-ad38-fdbb86807593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:41.822193 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:41.822841 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:41.826051 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-904b1cfc-6d7d-41cc-ad38-fdbb86807593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:41.826501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-904b1cfc-6d7d-41cc-ad38-fdbb86807593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:41.827268 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-904b1cfc-6d7d-41cc-ad38-fdbb86807593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:41.827724 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-904b1cfc-6d7d-41cc-ad38-fdbb86807593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:41.829573 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:41.830034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:41.830807 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:41.831248 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:41.969968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-904b1cfc-6d7d-41cc-ad38-fdbb86807593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:41.976691 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:41.978018 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-904b1cfc-6d7d-41cc-ad38-fdbb86807593 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.165880 Jul 21 08:32:41.978601 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 155/316] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:41 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:41.986442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:41.988096 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:41.989559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-770a698b-3267-48c1-8fca-26b82001af29 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.171175 Jul 21 08:32:41.990243 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 162/317] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:41 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:32:42.821694 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c9e7aed7-b67f-4fab-bf91-4a990cd66bb8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:42.822124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c9e7aed7-b67f-4fab-bf91-4a990cd66bb8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:42.828380 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9e7aed7-b67f-4fab-bf91-4a990cd66bb8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:42.828954 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9e7aed7-b67f-4fab-bf91-4a990cd66bb8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:42.829780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9e7aed7-b67f-4fab-bf91-4a990cd66bb8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:42.830270 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9e7aed7-b67f-4fab-bf91-4a990cd66bb8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:42.965660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c9e7aed7-b67f-4fab-bf91-4a990cd66bb8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:42.973615 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c9e7aed7-b67f-4fab-bf91-4a990cd66bb8 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1314 microversion: 2.1 time: 0.156618 Jul 21 08:32:42.974189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 156/318] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:42 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:42.995597 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d69b74cc-8e64-4f3f-9acb-c6798da19e26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:42.996209 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d69b74cc-8e64-4f3f-9acb-c6798da19e26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:43.002847 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d69b74cc-8e64-4f3f-9acb-c6798da19e26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:43.003295 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d69b74cc-8e64-4f3f-9acb-c6798da19e26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:43.004588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d69b74cc-8e64-4f3f-9acb-c6798da19e26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:43.005030 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d69b74cc-8e64-4f3f-9acb-c6798da19e26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:43.014159 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:43.015492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:43.021987 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:43.022434 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:43.023276 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:43.023876 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:43.149931 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d69b74cc-8e64-4f3f-9acb-c6798da19e26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:43.159319 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d69b74cc-8e64-4f3f-9acb-c6798da19e26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.167247 Jul 21 08:32:43.169093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 163/319] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:42 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:43.169553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:43.173351 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:43.183577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:43.183577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:43.183577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-358fc60d-9974-411f-9c22-8df655403ecd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.176133 Jul 21 08:32:43.183862 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 157/320] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:43 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:32:43.997900 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bd4363ff-0f2e-4a5f-87df-e38aa831229c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:43.998683 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bd4363ff-0f2e-4a5f-87df-e38aa831229c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:44.006138 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd4363ff-0f2e-4a5f-87df-e38aa831229c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:44.006565 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd4363ff-0f2e-4a5f-87df-e38aa831229c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:44.007362 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd4363ff-0f2e-4a5f-87df-e38aa831229c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:44.008142 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd4363ff-0f2e-4a5f-87df-e38aa831229c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:44.173591 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bd4363ff-0f2e-4a5f-87df-e38aa831229c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:44.177730 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-236dcd51-ddd1-40c8-924c-754750396369 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:44.179890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-236dcd51-ddd1-40c8-924c-754750396369 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:44.183826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bd4363ff-0f2e-4a5f-87df-e38aa831229c tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1499 microversion: 2.1 time: 0.196948 Jul 21 08:32:44.184624 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 164/321] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:43 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1499 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:44.195927 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236dcd51-ddd1-40c8-924c-754750396369 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:44.197056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236dcd51-ddd1-40c8-924c-754750396369 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:44.198989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236dcd51-ddd1-40c8-924c-754750396369 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:44.199472 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236dcd51-ddd1-40c8-924c-754750396369 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:44.228086 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:44.229000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:44.250756 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:44.251388 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:44.252498 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:44.252732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:44.435425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-236dcd51-ddd1-40c8-924c-754750396369 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:44.461149 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-236dcd51-ddd1-40c8-924c-754750396369 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.288504 Jul 21 08:32:44.465638 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 158/322] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:44 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:44.477255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:44.510146 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:44.510146 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:44.516316 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e1d91405-d327-48f2-9d40-366614b6f499 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.316439 Jul 21 08:32:44.516316 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 165/323] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:44 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:44.871271 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ed5c9cf-dcbe-4a5b-a066-eb96a83f0427 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:44.871890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ed5c9cf-dcbe-4a5b-a066-eb96a83f0427 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:44.882112 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ed5c9cf-dcbe-4a5b-a066-eb96a83f0427 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:44.882112 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ed5c9cf-dcbe-4a5b-a066-eb96a83f0427 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:44.882112 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ed5c9cf-dcbe-4a5b-a066-eb96a83f0427 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:44.882112 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ed5c9cf-dcbe-4a5b-a066-eb96a83f0427 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:44.908569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ed5c9cf-dcbe-4a5b-a066-eb96a83f0427 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:32:45.091221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ed5c9cf-dcbe-4a5b-a066-eb96a83f0427 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 204 len: 0 microversion: 2.1 time: 0.225235 Jul 21 08:32:45.092536 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 159/324] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:32:44 2022] DELETE /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:32:45.100702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1bd67d73-1960-47ec-8913-8307f5cd062a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:45.102914 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1bd67d73-1960-47ec-8913-8307f5cd062a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:45.111682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1bd67d73-1960-47ec-8913-8307f5cd062a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.112464 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1bd67d73-1960-47ec-8913-8307f5cd062a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.113742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1bd67d73-1960-47ec-8913-8307f5cd062a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.114186 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1bd67d73-1960-47ec-8913-8307f5cd062a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.290714 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1bd67d73-1960-47ec-8913-8307f5cd062a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:45.303557 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1bd67d73-1960-47ec-8913-8307f5cd062a tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1505 microversion: 2.1 time: 0.206577 Jul 21 08:32:45.304235 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 166/325] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:45 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:45.494825 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4b8aa74-486a-49d8-96c1-66f92a587b0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:45.495584 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4b8aa74-486a-49d8-96c1-66f92a587b0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:45.504312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4b8aa74-486a-49d8-96c1-66f92a587b0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.504966 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4b8aa74-486a-49d8-96c1-66f92a587b0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.505756 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4b8aa74-486a-49d8-96c1-66f92a587b0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.506192 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4b8aa74-486a-49d8-96c1-66f92a587b0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.540110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:45.541033 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:45.548455 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.549162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.550121 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.550702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.729167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4b8aa74-486a-49d8-96c1-66f92a587b0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:45.739278 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4b8aa74-486a-49d8-96c1-66f92a587b0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1501 microversion: 2.1 time: 0.256849 Jul 21 08:32:45.750992 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 160/326] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:45 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1501 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:45.761491 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36773fab-5e4d-40a1-818e-a75cc9613aa8"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:45.762816 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:45.768894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.769339 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.770146 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.770684 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.796926 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] HTTP exception thrown: Cannot 'attach_volume' instance a142cdd4-307c-476e-a178-54914626cda0 while it is in vm_state rescued Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Request method failure captured: Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: POST /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0/os-volume_attachments HTTP/1.1 Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 74 Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6iM3ePdQNOYU9NrpZdSW4k5-tepkW1LXnF6xRNHWXzWwVe2K6dnDtR3dekzKN6kda1f2LJgjvXP36sczxR0S88U2jjKCXvgq3JucN9neKfptczv3FD2wZGwDlmv9_n-KoklrOHHAuEWSWzSa1xT8JTkbN_FOiRQDDENLNKjXqTGOg Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:32:45.798806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 3528104f3e914d62a10e80e13d3c97de Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {"volumeAttachment": {"volumeId": "36773fab-5e4d-40a1-818e-a75cc9613aa8"}} Jul 21 08:32:45.800158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Cannot 'attach_volume' instance a142cdd4-307c-476e-a178-54914626cda0 while it is in vm_state rescued Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'server_id': 'a142cdd4-307c-476e-a178-54914626cda0', 'body': {'volumeAttachment': {'volumeId': '36773fab-5e4d-40a1-818e-a75cc9613aa8'}}} Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a142cdd4-307c-476e-a178-54914626cda0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:45.802861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a142cdd4-307c-476e-a178-54914626cda0 while it is in vm_state rescued Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:45.805330 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:45.806672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:45.806672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:45.806672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a142cdd4-307c-476e-a178-54914626cda0 while it is in vm_state rescued Jul 21 08:32:45.806672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:32:45.806672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Returning 409 to user: Cannot 'attach_volume' instance a142cdd4-307c-476e-a178-54914626cda0 while it is in vm_state rescued {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:45.806672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3e61594-0166-477d-8785-ae3f66e80255 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042817 Jul 21 08:32:45.806672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 161/327] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:32:45 2022] POST /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 21 08:32:45.813801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7427d2f0-64d3-480a-83a9-96c09fc05d26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:45.813801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7427d2f0-64d3-480a-83a9-96c09fc05d26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:45.820023 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7427d2f0-64d3-480a-83a9-96c09fc05d26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.820476 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7427d2f0-64d3-480a-83a9-96c09fc05d26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.821230 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7427d2f0-64d3-480a-83a9-96c09fc05d26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.821654 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7427d2f0-64d3-480a-83a9-96c09fc05d26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.889145 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:45.894993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7427d2f0-64d3-480a-83a9-96c09fc05d26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0/action" status: 202 len: 0 microversion: 2.1 time: 0.085572 Jul 21 08:32:45.895651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 162/328] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:32:45 2022] POST /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:32:45.900270 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:45.902259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:45.903546 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5a388390-ac57-40b0-b1e0-8b6c57ce6858 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.370029 Jul 21 08:32:45.904294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 167/329] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:45 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:45.905901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb99155b-efb3-40bd-983c-04abaf640a1b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:45.906997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb99155b-efb3-40bd-983c-04abaf640a1b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:45.914641 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb99155b-efb3-40bd-983c-04abaf640a1b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.915417 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb99155b-efb3-40bd-983c-04abaf640a1b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:45.916317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb99155b-efb3-40bd-983c-04abaf640a1b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:45.917360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb99155b-efb3-40bd-983c-04abaf640a1b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:46.110171 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fb99155b-efb3-40bd-983c-04abaf640a1b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:46.117849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb99155b-efb3-40bd-983c-04abaf640a1b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1509 microversion: 2.1 time: 0.217286 Jul 21 08:32:46.118529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 163/330] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:45 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:46.175940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4d753261-0dcb-461b-8b31-c10c13fd4fed tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:46.176570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4d753261-0dcb-461b-8b31-c10c13fd4fed tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:46.183792 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d753261-0dcb-461b-8b31-c10c13fd4fed tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:46.184294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d753261-0dcb-461b-8b31-c10c13fd4fed tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:46.185130 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d753261-0dcb-461b-8b31-c10c13fd4fed tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:46.185630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d753261-0dcb-461b-8b31-c10c13fd4fed tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:46.319650 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-4d753261-0dcb-461b-8b31-c10c13fd4fed tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lazy-loading 'services' on Instance uuid c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:32:46.322040 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fe13646c-337e-4aac-89f7-558674488ac4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:46.322790 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fe13646c-337e-4aac-89f7-558674488ac4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:46.330311 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe13646c-337e-4aac-89f7-558674488ac4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:46.330807 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe13646c-337e-4aac-89f7-558674488ac4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:46.331893 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe13646c-337e-4aac-89f7-558674488ac4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:46.332402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe13646c-337e-4aac-89f7-558674488ac4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:46.457216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4d753261-0dcb-461b-8b31-c10c13fd4fed tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89/os-volume_attachments/6a08887d-a709-4c20-996c-5c0d0228fe8a" status: 202 len: 0 microversion: 2.1 time: 0.287596 Jul 21 08:32:46.457833 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 168/331] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:32:46 2022] DELETE /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89/os-volume_attachments/6a08887d-a709-4c20-996c-5c0d0228fe8a => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:32:46.504071 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe13646c-337e-4aac-89f7-558674488ac4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:46.513123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fe13646c-337e-4aac-89f7-558674488ac4 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1505 microversion: 2.1 time: 0.195579 Jul 21 08:32:46.514404 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 164/332] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:46 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:46.924445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:46.925465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:46.934381 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:46.935062 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:46.936016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:46.936566 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:47.083556 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:47.092590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:47.094824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:47.096003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-065e7d81-75f3-4d6b-baa6-b6949bc6f611 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.177650 Jul 21 08:32:47.096578 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 169/333] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:46 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:47.136520 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-39a9465a-ea89-4da4-b89c-3ab401c6d5e7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:47.137623 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-39a9465a-ea89-4da4-b89c-3ab401c6d5e7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:47.144936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39a9465a-ea89-4da4-b89c-3ab401c6d5e7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:47.145694 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39a9465a-ea89-4da4-b89c-3ab401c6d5e7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:47.146779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39a9465a-ea89-4da4-b89c-3ab401c6d5e7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:47.147516 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39a9465a-ea89-4da4-b89c-3ab401c6d5e7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:47.524075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-39a9465a-ea89-4da4-b89c-3ab401c6d5e7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:47.534316 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-39a9465a-ea89-4da4-b89c-3ab401c6d5e7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1509 microversion: 2.1 time: 0.402557 Jul 21 08:32:47.536656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c148d058-c0ce-40b9-a5ed-2d8f5d1b60c0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:47.538301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c148d058-c0ce-40b9-a5ed-2d8f5d1b60c0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:47.545292 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 165/334] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:47 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1509 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:47.546756 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:47.550729 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c148d058-c0ce-40b9-a5ed-2d8f5d1b60c0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:47.551444 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c148d058-c0ce-40b9-a5ed-2d8f5d1b60c0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:47.552578 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c148d058-c0ce-40b9-a5ed-2d8f5d1b60c0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:47.553368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c148d058-c0ce-40b9-a5ed-2d8f5d1b60c0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:47.737499 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c148d058-c0ce-40b9-a5ed-2d8f5d1b60c0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:47.746515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c148d058-c0ce-40b9-a5ed-2d8f5d1b60c0 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1505 microversion: 2.1 time: 0.220121 Jul 21 08:32:47.747109 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 170/335] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:47 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:48.121218 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:48.121824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:48.128554 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:48.129921 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:48.130127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:48.130501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:48.345609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:48.355114 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:48.356828 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:48.358244 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10a94929-197c-433c-8993-d6c81fcb6ac7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.241613 Jul 21 08:32:48.359254 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 166/336] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:48 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:48.552231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-13b8f4f6-1e65-43ab-af45-e3bb6164caba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:48.553844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-13b8f4f6-1e65-43ab-af45-e3bb6164caba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:48.563851 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13b8f4f6-1e65-43ab-af45-e3bb6164caba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:48.564587 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13b8f4f6-1e65-43ab-af45-e3bb6164caba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:48.565599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13b8f4f6-1e65-43ab-af45-e3bb6164caba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:48.566216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13b8f4f6-1e65-43ab-af45-e3bb6164caba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:48.764387 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fef95237-68ad-4e55-b408-45c7e3baf2ae tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:48.765230 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-13b8f4f6-1e65-43ab-af45-e3bb6164caba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:48.765469 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fef95237-68ad-4e55-b408-45c7e3baf2ae tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:48.777395 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-13b8f4f6-1e65-43ab-af45-e3bb6164caba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1509 microversion: 2.1 time: 0.228959 Jul 21 08:32:48.784452 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fef95237-68ad-4e55-b408-45c7e3baf2ae tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:48.785220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fef95237-68ad-4e55-b408-45c7e3baf2ae tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:48.786178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fef95237-68ad-4e55-b408-45c7e3baf2ae tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:48.786543 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fef95237-68ad-4e55-b408-45c7e3baf2ae tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:48.788846 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 171/337] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:48 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:49.076439 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fef95237-68ad-4e55-b408-45c7e3baf2ae tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:49.091653 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fef95237-68ad-4e55-b408-45c7e3baf2ae tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1505 microversion: 2.1 time: 0.331516 Jul 21 08:32:49.093450 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 167/338] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:48 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:49.378358 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:49.379242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:49.387046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:49.388160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:49.389852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:49.390700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:49.645857 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:49.659318 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:49.660836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:49.662285 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c8768dc9-efd7-4491-8010-4480da8044cd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.287734 Jul 21 08:32:49.663948 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 172/339] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:49 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:49.794352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-34c267bd-7898-4193-89ef-e4b25d6862d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:49.795077 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-34c267bd-7898-4193-89ef-e4b25d6862d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:49.804229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34c267bd-7898-4193-89ef-e4b25d6862d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:49.804956 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34c267bd-7898-4193-89ef-e4b25d6862d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:49.806466 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34c267bd-7898-4193-89ef-e4b25d6862d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:49.806955 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34c267bd-7898-4193-89ef-e4b25d6862d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:50.108762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-da64dc2a-9216-4bf9-b1c2-4992d2708546 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:50.109737 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-da64dc2a-9216-4bf9-b1c2-4992d2708546 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:50.119029 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-da64dc2a-9216-4bf9-b1c2-4992d2708546 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:50.120412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-da64dc2a-9216-4bf9-b1c2-4992d2708546 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:50.123312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-da64dc2a-9216-4bf9-b1c2-4992d2708546 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:50.124054 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-da64dc2a-9216-4bf9-b1c2-4992d2708546 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:50.253250 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34c267bd-7898-4193-89ef-e4b25d6862d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:50.264583 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-34c267bd-7898-4193-89ef-e4b25d6862d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1509 microversion: 2.1 time: 0.474171 Jul 21 08:32:50.277429 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 168/340] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:49 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1509 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:50.478143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-da64dc2a-9216-4bf9-b1c2-4992d2708546 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:50.488070 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-da64dc2a-9216-4bf9-b1c2-4992d2708546 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1505 microversion: 2.1 time: 0.382999 Jul 21 08:32:50.498091 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 173/341] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:50 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:50.683503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:50.684026 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:50.691059 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:50.691781 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:50.693057 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:50.693827 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:50.853142 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-eaf18042-5bfa-4a85-837f-8fe7cc2f0785 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:50.854313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eaf18042-5bfa-4a85-837f-8fe7cc2f0785 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:50.863048 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eaf18042-5bfa-4a85-837f-8fe7cc2f0785 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:50.863559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eaf18042-5bfa-4a85-837f-8fe7cc2f0785 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:50.864347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eaf18042-5bfa-4a85-837f-8fe7cc2f0785 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:50.864854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eaf18042-5bfa-4a85-837f-8fe7cc2f0785 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:50.914986 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eaf18042-5bfa-4a85-837f-8fe7cc2f0785 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:32:51.045526 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-eaf18042-5bfa-4a85-837f-8fe7cc2f0785 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 204 len: 0 microversion: 2.1 time: 0.195746 Jul 21 08:32:51.047265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 174/342] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:32:50 2022] DELETE /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:32:51.066993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-fe6e13ac-0a3a-4cff-a5c0-4a27c7c54a3a req-66295e84-e418-4ced-97da-1d2b059fa553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7cf7ee4-1677-4bdd-9cf1-879a34e41929", "name": "network-vif-deleted", "tag": "22d97224-e481-48a3-864e-fc525c352bb2"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:51.091078 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-fe6e13ac-0a3a-4cff-a5c0-4a27c7c54a3a req-66295e84-e418-4ced-97da-1d2b059fa553 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:51.091810 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-fe6e13ac-0a3a-4cff-a5c0-4a27c7c54a3a req-66295e84-e418-4ced-97da-1d2b059fa553 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:51.099796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:51.135225 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-fe6e13ac-0a3a-4cff-a5c0-4a27c7c54a3a req-66295e84-e418-4ced-97da-1d2b059fa553 service nova] Creating event network-vif-deleted:22d97224-e481-48a3-864e-fc525c352bb2 for instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 on hv-cinder-85032 Jul 21 08:32:51.149618 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:51.150096 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-fe6e13ac-0a3a-4cff-a5c0-4a27c7c54a3a req-66295e84-e418-4ced-97da-1d2b059fa553 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099853 Jul 21 08:32:51.150477 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 175/343] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:51.180226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0ea3d057-b7fd-4b0a-84f6-f4a83e714388 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:51.180226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0ea3d057-b7fd-4b0a-84f6-f4a83e714388 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:51.180483 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:51.183519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ea3d057-b7fd-4b0a-84f6-f4a83e714388 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:51.183982 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ea3d057-b7fd-4b0a-84f6-f4a83e714388 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:51.184768 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ea3d057-b7fd-4b0a-84f6-f4a83e714388 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:51.185209 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ea3d057-b7fd-4b0a-84f6-f4a83e714388 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:51.187752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:51.194789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de4f06ea-b73c-4cb8-983c-eccdc3115d56 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.516236 Jul 21 08:32:51.204279 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 169/344] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:50 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:51.284765 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-35c55a47-94c8-43bd-9cf6-9a9bd4975911 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:51.285641 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-35c55a47-94c8-43bd-9cf6-9a9bd4975911 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:51.289913 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:51.303631 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35c55a47-94c8-43bd-9cf6-9a9bd4975911 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:51.305357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35c55a47-94c8-43bd-9cf6-9a9bd4975911 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:51.306253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35c55a47-94c8-43bd-9cf6-9a9bd4975911 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:51.307155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-35c55a47-94c8-43bd-9cf6-9a9bd4975911 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:51.430015 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0ea3d057-b7fd-4b0a-84f6-f4a83e714388 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:51.442059 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0ea3d057-b7fd-4b0a-84f6-f4a83e714388 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1515 microversion: 2.1 time: 0.286627 Jul 21 08:32:51.443166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 176/345] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:51 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:51.501264 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-35c55a47-94c8-43bd-9cf6-9a9bd4975911 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:51.505236 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:51.505887 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:51.520596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:51.520830 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:51.521628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:51.522063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:51.522516 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-35c55a47-94c8-43bd-9cf6-9a9bd4975911 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1509 microversion: 2.1 time: 0.240664 Jul 21 08:32:51.534043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 170/346] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:51 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:51.578451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:51.579370 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:51.580150 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lazy-loading 'fault' on Instance uuid e7cf7ee4-1677-4bdd-9cf1-879a34e41929 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:32:51.648716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:51.659524 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-79997d53-449c-4ee7-bcff-3485884cb1ef tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1304 microversion: 2.1 time: 0.158557 Jul 21 08:32:51.660592 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 177/347] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:51 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:52.222831 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:52.224116 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:52.232168 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.232752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.233526 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.234140 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.382496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:52.390855 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:52.392449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:52.393636 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-64c8b015-f4fa-4f12-bf55-4ea0482173da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.183660 Jul 21 08:32:52.399489 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 171/348] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:52 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:52.460518 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-835afac5-6165-4069-b63c-9039fbe9a7e2 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:52.461133 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-835afac5-6165-4069-b63c-9039fbe9a7e2 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:52.468465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-835afac5-6165-4069-b63c-9039fbe9a7e2 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.469106 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-835afac5-6165-4069-b63c-9039fbe9a7e2 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.470043 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-835afac5-6165-4069-b63c-9039fbe9a7e2 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.470789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-835afac5-6165-4069-b63c-9039fbe9a7e2 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.540747 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-245137c9-52ed-4747-a63c-2c8c86122ebe tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:52.541780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-245137c9-52ed-4747-a63c-2c8c86122ebe tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:52.552322 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-245137c9-52ed-4747-a63c-2c8c86122ebe tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.553346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-245137c9-52ed-4747-a63c-2c8c86122ebe tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.555713 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-245137c9-52ed-4747-a63c-2c8c86122ebe tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.556376 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-245137c9-52ed-4747-a63c-2c8c86122ebe tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.640944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:52.655102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-835afac5-6165-4069-b63c-9039fbe9a7e2 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:52.665699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-835afac5-6165-4069-b63c-9039fbe9a7e2 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1515 microversion: 2.1 time: 0.208877 Jul 21 08:32:52.667008 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 178/349] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:52 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:52.677583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:52.679088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:52.686866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.688321 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.689495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.690397 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.737604 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:52.738490 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:52.739614 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lazy-loading 'fault' on Instance uuid e7cf7ee4-1677-4bdd-9cf1-879a34e41929 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:32:52.793943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:52.803423 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-86e43ce7-f237-4d88-b9a5-d6e5a1c1591e tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1304 microversion: 2.1 time: 0.129807 Jul 21 08:32:52.804457 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 179/350] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:52 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:52.995701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-245137c9-52ed-4747-a63c-2c8c86122ebe tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:53.003159 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-245137c9-52ed-4747-a63c-2c8c86122ebe tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1509 microversion: 2.1 time: 0.467411 Jul 21 08:32:53.014336 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 172/351] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:52 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:53.413801 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:53.414971 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:53.421825 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:53.422807 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:53.423904 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:53.424770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:53.616128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:53.626843 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:53.630424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:53.631900 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c305a80-41b3-415e-9fdf-2e573661d3be tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.222803 Jul 21 08:32:53.633231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 180/352] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:53 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:53.684558 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-44032384-f138-4619-8369-d39953678a30 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:53.685764 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-44032384-f138-4619-8369-d39953678a30 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:53.699352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44032384-f138-4619-8369-d39953678a30 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:53.700135 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44032384-f138-4619-8369-d39953678a30 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:53.702562 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44032384-f138-4619-8369-d39953678a30 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:53.703180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44032384-f138-4619-8369-d39953678a30 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:53.826366 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:53.826966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:53.833656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:53.835471 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:53.838022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:53.839853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:53.893297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:53.894553 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:53.895555 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lazy-loading 'fault' on Instance uuid e7cf7ee4-1677-4bdd-9cf1-879a34e41929 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:32:53.962262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:53.976897 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c9091663-8a0e-41c8-b002-69dc12c4639f tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1304 microversion: 2.1 time: 0.151148 Jul 21 08:32:53.978692 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 181/353] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:53 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:53.991923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-55c23eb0-b24e-42fb-b786-763c598d449f req-6394eed0-c01c-462d-ae09-af14f920e3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89", "name": "network-vif-unplugged", "status": "completed", "tag": "65b822e8-8b30-4d16-acb1-6c6fa99efa0c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:54.021000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-55c23eb0-b24e-42fb-b786-763c598d449f req-6394eed0-c01c-462d-ae09-af14f920e3f6 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:54.021459 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-55c23eb0-b24e-42fb-b786-763c598d449f req-6394eed0-c01c-462d-ae09-af14f920e3f6 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:54.049252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-55c23eb0-b24e-42fb-b786-763c598d449f req-6394eed0-c01c-462d-ae09-af14f920e3f6 service nova] Creating event network-vif-unplugged:65b822e8-8b30-4d16-acb1-6c6fa99efa0c for instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 on hv-cinder-85032 Jul 21 08:32:54.060233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-55c23eb0-b24e-42fb-b786-763c598d449f req-6394eed0-c01c-462d-ae09-af14f920e3f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078778 Jul 21 08:32:54.062508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 182/354] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:54.072989 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-de057d34-5f8a-4247-90a8-0d2cbe5c2062 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:54.073734 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-de057d34-5f8a-4247-90a8-0d2cbe5c2062 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:54.093062 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de057d34-5f8a-4247-90a8-0d2cbe5c2062 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:54.093964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de057d34-5f8a-4247-90a8-0d2cbe5c2062 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:54.100248 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de057d34-5f8a-4247-90a8-0d2cbe5c2062 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:54.100712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de057d34-5f8a-4247-90a8-0d2cbe5c2062 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:54.178269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-44032384-f138-4619-8369-d39953678a30 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:54.194715 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-44032384-f138-4619-8369-d39953678a30 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1515 microversion: 2.1 time: 0.514714 Jul 21 08:32:54.199011 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 173/355] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:53 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1515 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:54.329833 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-de057d34-5f8a-4247-90a8-0d2cbe5c2062 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:54.343675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-de057d34-5f8a-4247-90a8-0d2cbe5c2062 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1509 microversion: 2.1 time: 0.278686 Jul 21 08:32:54.345749 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 183/356] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:54 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:54.659101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:54.660233 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:54.686043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:54.695476 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:54.696454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:54.698357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:54.998487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:54.999097 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:55.022066 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:55.022431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:55.023206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:55.023667 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:55.087297 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:55.119086 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:55.123611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:55.126549 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37db66bb-92cb-499f-a0a3-464f13ec3919 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.478255 Jul 21 08:32:55.133351 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 174/357] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:54 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:32:55.157094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:55.163424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:55.167263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lazy-loading 'fault' on Instance uuid e7cf7ee4-1677-4bdd-9cf1-879a34e41929 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:32:55.217012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ad62a7c-705a-4d38-97a5-1b19025a09fc tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:55.217783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ad62a7c-705a-4d38-97a5-1b19025a09fc tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:55.239758 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ad62a7c-705a-4d38-97a5-1b19025a09fc tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:55.240609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ad62a7c-705a-4d38-97a5-1b19025a09fc tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:55.243740 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ad62a7c-705a-4d38-97a5-1b19025a09fc tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:55.245027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ad62a7c-705a-4d38-97a5-1b19025a09fc tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:55.363264 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa156584880d4449bd89a7bcdcfe403f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c163cbb79544869bb823308163a4142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:55.376923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5b2965b4-ee7b-4e1b-a60d-212e4d77df75 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 200 len: 1304 microversion: 2.1 time: 0.385825 Jul 21 08:32:55.378576 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 184/358] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:54 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 1304 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:55.389471 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fda6f756-a455-4862-8db8-b6e959c4fea0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:55.392436 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fda6f756-a455-4862-8db8-b6e959c4fea0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:55.408293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fda6f756-a455-4862-8db8-b6e959c4fea0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:55.409382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fda6f756-a455-4862-8db8-b6e959c4fea0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:55.410574 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fda6f756-a455-4862-8db8-b6e959c4fea0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:55.411223 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fda6f756-a455-4862-8db8-b6e959c4fea0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:55.519405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2ad62a7c-705a-4d38-97a5-1b19025a09fc tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:55.534829 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ad62a7c-705a-4d38-97a5-1b19025a09fc tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 200 len: 1473 microversion: 2.1 time: 0.323189 Jul 21 08:32:55.546339 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 175/359] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:55 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 1473 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:32:55.553786 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-be6f2f91-054c-4e6f-ba10-d76a7e91d0d4 req-8a13e70f-e9e1-4dce-b48d-d891b6c6dd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89", "name": "network-vif-deleted", "tag": "65b822e8-8b30-4d16-acb1-6c6fa99efa0c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:55.581841 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-be6f2f91-054c-4e6f-ba10-d76a7e91d0d4 req-8a13e70f-e9e1-4dce-b48d-d891b6c6dd41 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:55.585569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-be6f2f91-054c-4e6f-ba10-d76a7e91d0d4 req-8a13e70f-e9e1-4dce-b48d-d891b6c6dd41 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:55.614975 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-be6f2f91-054c-4e6f-ba10-d76a7e91d0d4 req-8a13e70f-e9e1-4dce-b48d-d891b6c6dd41 service nova] Creating event network-vif-deleted:65b822e8-8b30-4d16-acb1-6c6fa99efa0c for instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 on hv-cinder-85032 Jul 21 08:32:55.640605 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-be6f2f91-054c-4e6f-ba10-d76a7e91d0d4 req-8a13e70f-e9e1-4dce-b48d-d891b6c6dd41 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095563 Jul 21 08:32:55.641209 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 176/360] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:55.677268 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fda6f756-a455-4862-8db8-b6e959c4fea0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:55.694682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fda6f756-a455-4862-8db8-b6e959c4fea0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1515 microversion: 2.1 time: 0.312051 Jul 21 08:32:55.699236 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 185/361] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:55 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1515 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:32:56.148387 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:56.149081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:56.172157 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:56.172885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:56.173826 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:56.175118 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:56.395301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:56.396531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] [instance: e7cf7ee4-1677-4bdd-9cf1-879a34e41929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:56.416290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:56.417802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:56.419658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:56.420555 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:56.447567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] HTTP exception thrown: Instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 could not be found. Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Request method failure captured: Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 HTTP/1.1 Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q77qlG1ajv6xNuM7xi9cdqngxKPwxLuPNS5nn7cYgxc1_uB_8usu-RM1ieMKst41SEXM57ooscMv8KS8G6NGV9IkU2TFxpsHogGXMeOFCaC19r8N6zUVKKv5ISBdsZmksY8F9cSQZxQyE69VacylIOWUtgNO8L8D5BJtw16yMcWqaA Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 6c163cbb79544869bb823308163a4142 Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesActionsTest-1285320438 Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:56.449259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c163cbb79544869bb823308163a4142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c163cbb79544869bb823308163a4142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c163cbb79544869bb823308163a4142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c163cbb79544869bb823308163a4142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesActionsTest-1285320438 Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 6c163cbb79544869bb823308163a4142 Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesActionsTest-1285320438 Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesActionsTest-1285320438-project Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: aa156584880d4449bd89a7bcdcfe403f Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesActionsTest-1285320438-project Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 could not be found. Jul 21 08:32:56.450836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'e7cf7ee4-1677-4bdd-9cf1-879a34e41929'} Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 could not be found. Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:56.451783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 could not be found. Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 could not be found. Jul 21 08:32:56.453218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.456439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] Returning 404 to user: Instance e7cf7ee4-1677-4bdd-9cf1-879a34e41929 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:56.457415 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-667e79b0-e76e-48ac-9fc3-571e093fb264 tempest-VolumesActionsTest-1285320438 tempest-VolumesActionsTest-1285320438-project] 10.222.0.47 "GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929" status: 404 len: 111 microversion: 2.1 time: 0.066009 Jul 21 08:32:56.458841 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 186/362] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:56 2022] GET /compute/v2.1/servers/e7cf7ee4-1677-4bdd-9cf1-879a34e41929 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:32:56.477556 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:56.490382 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:56.491940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:56.493216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0c1894ea-26a5-4d0b-b099-e82cbb8cfbd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.350853 Jul 21 08:32:56.495999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 177/363] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:56 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:56.561844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:56.564511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:56.581841 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:56.582664 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:56.584321 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:56.586518 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:56.608230 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] HTTP exception thrown: Instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 could not be found. Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Request method failure captured: Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 HTTP/1.1 Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q7NKaqJdvs7SS5EiTYBs5oNxxYPfnefTJDaS7rkEEPNd-xv8pdXQ2EnaXfMKuiuAzbK3qkl0auiHuxcHgIFfA91xGQwt8OQURPmSJpXTR7qdV_L1lQdp3u2rInhZ8wmlnOC9vs83X07UN0k9dDxuvnHHrQvwu3Z99TlOZ3GK0TX-0s Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 419b6c6707544364b82f3f6fb5030032 Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotTestJSON-654560829 Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:32:56.610458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/419b6c6707544364b82f3f6fb5030032"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_419b6c6707544364b82f3f6fb5030032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/419b6c6707544364b82f3f6fb5030032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/419b6c6707544364b82f3f6fb5030032"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotTestJSON-654560829 Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 419b6c6707544364b82f3f6fb5030032 Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-654560829 Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotTestJSON-654560829-project Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 1f914243baf846f5b43a929332bcef6e Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotTestJSON-654560829-project Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 could not be found. Jul 21 08:32:56.611753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89'} Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 could not be found. Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:32:56.612504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 could not be found. Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 could not be found. Jul 21 08:32:56.613595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:32:56.616348 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Returning 404 to user: Instance c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:32:56.617247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3a4d60bb-8e07-4ee6-b755-b33f3737f857 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89" status: 404 len: 111 microversion: 2.1 time: 0.060776 Jul 21 08:32:56.622953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 187/364] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:32:56 2022] GET /compute/v2.1/servers/c0daf9a3-2d82-4ded-a6b2-5c7110a1ca89 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:32:57.411154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e81bfd71-5b29-4cb9-af76-0e7f11d4cbb7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'create', calling method: .version_select at 0x7f65bc6073a0>, body: {"keypair": {"name": "tempest-keypair-1689372369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTMrp9WVX1Fed63qj/wdTKJxBRhNk9Es+FZsz24bBxc8PcbzRanM4C8Xj5hPqZFZeeCJ0Aq/krqzTlu6I6AsuQf5Xslc5lnFocVoZZGD6cz4jQaEK70IFYUIgeUdFng5A=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:57.428389 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-e81bfd71-5b29-4cb9-af76-0e7f11d4cbb7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Getting quotas for project b27a1d777abf4d139048716280a4bb4f. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:32:57.434195 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-e81bfd71-5b29-4cb9-af76-0e7f11d4cbb7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Getting quotas for user 3528104f3e914d62a10e80e13d3c97de and project b27a1d777abf4d139048716280a4bb4f. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:32:57.462396 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e81bfd71-5b29-4cb9-af76-0e7f11d4cbb7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055183 Jul 21 08:32:57.463311 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 178/365] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:32:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:32:57.513831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:57.515313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:57.526490 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:57.527259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:57.537917 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:57.540694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:58.165461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:58.175663 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:58.177651 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:58.178840 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80b24642-cedd-424e-8908-7cf6dcbd8e6b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.669709 Jul 21 08:32:58.179431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 188/366] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:57 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:59.211016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:32:59.212502 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:32:59.220160 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:59.220789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:59.221581 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:32:59.222671 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:32:59.451712 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:59.462038 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:59.464174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:32:59.466620 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2887303-166d-4aba-b842-133408f187b2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.271807 Jul 21 08:32:59.467645 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 179/367] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:32:59 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:32:59.495980 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f1669fad-40ec-4f64-b0f6-f772938288f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Action: 'create', calling method: .version_select at 0x7f65bcff0d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-853433119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITTV2QlkcLEovyt9NP67/wRmD4THnsjQriQzoAVwg06G5XzBdavoTUpmRucEKEu2eqElu2SVgLToxXqXdr4h0Tud8OvufzZqH7F/SucbMnNKnoZIPv6DQDJ8yEGAb3qAA=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:32:59.523477 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-f1669fad-40ec-4f64-b0f6-f772938288f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Getting quotas for project ccb36757791d463e92faf5dbaa0ff13a. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:32:59.529853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-f1669fad-40ec-4f64-b0f6-f772938288f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Getting quotas for user 45688a2eafb840e9b2b4c56bbee69375 and project ccb36757791d463e92faf5dbaa0ff13a. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:32:59.596570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f1669fad-40ec-4f64-b0f6-f772938288f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.385590 Jul 21 08:32:59.597483 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 189/368] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:32:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:00.370408 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-133958984", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2dadcd4-d21c-4f75-8863-8f3821dfa940"}], "security_groups": [{"name": "tempest-securitygroup--1253069592"}], "key_name": "tempest-keypair-1689372369", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:00.486287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:00.486880 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:00.502474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:00.503312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:00.504936 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:00.505587 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:00.707394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] validate_networks() for [('b2dadcd4-d21c-4f75-8863-8f3821dfa940', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:33:00.849136 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:00.860646 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:00.864804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:00.866264 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cc817513-f75d-4beb-b487-4106cc9db929 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.384676 Jul 21 08:33:00.881306 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 190/369] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:00 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:01.890053 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:01.892621 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:01.907087 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:01.910853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:01.912460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:01.913016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:02.287713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:02.317100 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:02.325834 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:02.330820 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3db715af-c885-4fbd-887a-c13b515a2726 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.446389 Jul 21 08:33:02.332090 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 191/370] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:01 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:02.492944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:33:02.492944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:33:02.493393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:33:02.493701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:33:02.494912 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:33:02.505146 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:02.505840 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:02.506903 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:02.507558 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:02.531212 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Getting quotas for project b27a1d777abf4d139048716280a4bb4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:33:02.542768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Getting quotas for user 3528104f3e914d62a10e80e13d3c97de and project b27a1d777abf4d139048716280a4bb4f. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:33:02.567137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:33:02.576167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:33:02.663082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd05ad7c-0885-4c52-8864-c9d2a03bd0f5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.301002 Jul 21 08:33:02.669573 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 180/371] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:33:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:33:02.676410 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0748db13-3a98-47fd-9c49-f5aa45b95f3a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:02.677233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0748db13-3a98-47fd-9c49-f5aa45b95f3a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:02.840504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0748db13-3a98-47fd-9c49-f5aa45b95f3a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:02.873779 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0748db13-3a98-47fd-9c49-f5aa45b95f3a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1245 microversion: 2.1 time: 0.201311 Jul 21 08:33:02.875074 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 192/372] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:02 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1245 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:03.352028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:03.352791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:03.364313 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:03.364771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:03.365562 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:03.365993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:03.608361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:03.626682 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:03.628563 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:03.630105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dbb16544-04a0-471a-ab6e-c8e594c01e49 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.283427 Jul 21 08:33:03.630663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 181/373] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:03 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:03.892755 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ff88e7f2-2174-4fbb-9d3d-8c503c8cb229 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:03.894074 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ff88e7f2-2174-4fbb-9d3d-8c503c8cb229 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:03.906477 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff88e7f2-2174-4fbb-9d3d-8c503c8cb229 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:03.908412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff88e7f2-2174-4fbb-9d3d-8c503c8cb229 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:03.909796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff88e7f2-2174-4fbb-9d3d-8c503c8cb229 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:03.911999 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff88e7f2-2174-4fbb-9d3d-8c503c8cb229 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:04.029492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ff88e7f2-2174-4fbb-9d3d-8c503c8cb229 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:04.038161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ff88e7f2-2174-4fbb-9d3d-8c503c8cb229 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1297 microversion: 2.1 time: 0.149457 Jul 21 08:33:04.039241 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 193/374] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:03 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1297 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:04.649849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:04.650478 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:04.664083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:04.664525 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:04.665534 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:04.666675 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:05.048202 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:05.057931 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5507ba71-cf38-4b9c-9bf1-2925521ff678 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:05.058829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5507ba71-cf38-4b9c-9bf1-2925521ff678 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:05.061126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:05.064416 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:05.066553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-23fdd765-aef8-46c2-85eb-8fd679d59b48 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1743 microversion: 2.20 time: 0.420079 Jul 21 08:33:05.079620 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 182/375] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:04 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1743 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:05.080287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5507ba71-cf38-4b9c-9bf1-2925521ff678 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:05.083514 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5507ba71-cf38-4b9c-9bf1-2925521ff678 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:05.086526 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5507ba71-cf38-4b9c-9bf1-2925521ff678 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:05.089324 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5507ba71-cf38-4b9c-9bf1-2925521ff678 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:05.214380 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5507ba71-cf38-4b9c-9bf1-2925521ff678 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:05.231526 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5507ba71-cf38-4b9c-9bf1-2925521ff678 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1303 microversion: 2.1 time: 0.179198 Jul 21 08:33:05.245709 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 194/376] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:05 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:06.095066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:06.097095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:06.108152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:06.108890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:06.110464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:06.111393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:06.257794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-72b696f8-fb21-43a3-beb3-5afaf49ab72e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:06.259244 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-72b696f8-fb21-43a3-beb3-5afaf49ab72e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:06.277614 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72b696f8-fb21-43a3-beb3-5afaf49ab72e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:06.278328 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72b696f8-fb21-43a3-beb3-5afaf49ab72e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:06.280182 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72b696f8-fb21-43a3-beb3-5afaf49ab72e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:06.280954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72b696f8-fb21-43a3-beb3-5afaf49ab72e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:06.290945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:06.382942 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:06.396389 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:06.407596 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:06.412872 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-603e8396-a259-4bd8-8946-d3dcb9d11dbd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1743 microversion: 2.20 time: 0.328096 Jul 21 08:33:06.413811 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 183/377] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:06 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1743 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:06.445283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-72b696f8-fb21-43a3-beb3-5afaf49ab72e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:06.453972 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-72b696f8-fb21-43a3-beb3-5afaf49ab72e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1303 microversion: 2.1 time: 0.206996 Jul 21 08:33:06.455008 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 195/378] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:06 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:07.433968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:07.435141 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:07.460378 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:07.465110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:07.476005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:07.477232 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:07.505930 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-59a17412-e1cc-47fc-84a7-51875128bf25 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:07.507290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-59a17412-e1cc-47fc-84a7-51875128bf25 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:07.517527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59a17412-e1cc-47fc-84a7-51875128bf25 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:07.518979 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59a17412-e1cc-47fc-84a7-51875128bf25 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:07.530570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59a17412-e1cc-47fc-84a7-51875128bf25 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:07.531432 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59a17412-e1cc-47fc-84a7-51875128bf25 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:07.857577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:07.868201 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:07.870976 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:07.872457 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-18329a39-24b1-4418-b39a-ec3ccafee49d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1743 microversion: 2.20 time: 0.445255 Jul 21 08:33:07.885492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 184/379] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:07 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1743 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:08.115088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-59a17412-e1cc-47fc-84a7-51875128bf25 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:08.125005 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-59a17412-e1cc-47fc-84a7-51875128bf25 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1303 microversion: 2.1 time: 0.655748 Jul 21 08:33:08.126265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 196/380] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:07 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1303 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:08.891945 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:08.892555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:08.900735 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:08.901496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:08.902489 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:08.903075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:09.144752 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1a29e25-754d-4d22-aa1a-9a17149aaff3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:09.145499 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a1a29e25-754d-4d22-aa1a-9a17149aaff3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:09.155938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1a29e25-754d-4d22-aa1a-9a17149aaff3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:09.160014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1a29e25-754d-4d22-aa1a-9a17149aaff3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:09.168140 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1a29e25-754d-4d22-aa1a-9a17149aaff3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:09.170123 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1a29e25-754d-4d22-aa1a-9a17149aaff3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:09.325822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:09.351561 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:09.358368 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:09.361793 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-46d70b01-b08b-4d00-bf11-ec40e441f9e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1743 microversion: 2.20 time: 0.473732 Jul 21 08:33:09.381711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 185/381] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:08 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1743 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:09.548062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-463754263", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "networks": [{"uuid": "3d7d50f4-aa56-4ed9-ae9c-589f9803dd64"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:09.730020 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a1a29e25-754d-4d22-aa1a-9a17149aaff3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:09.749326 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a1a29e25-754d-4d22-aa1a-9a17149aaff3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.606725 Jul 21 08:33:09.750248 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 197/382] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:09 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:10.385852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:10.386773 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:10.415262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:10.418074 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:10.420639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:10.423719 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:10.799040 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:10.830959 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:10.835984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:10.839171 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9d417027-1c54-4d9a-b798-0ce7b0fc411b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.457968 Jul 21 08:33:10.851427 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 198/383] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:10 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:10.876684 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-6e88621e-d443-4dcd-9736-f5696eed878b req-5697c198-d63b-44cf-a720-61450bf29a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a", "name": "network-vif-plugged", "status": "completed", "tag": "dc3ec772-1aa6-40c5-a783-9c70e0e921dd"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:10.890840 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-6e88621e-d443-4dcd-9736-f5696eed878b req-5697c198-d63b-44cf-a720-61450bf29a5f service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:10.891820 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-6e88621e-d443-4dcd-9736-f5696eed878b req-5697c198-d63b-44cf-a720-61450bf29a5f service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:10.910923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-6e88621e-d443-4dcd-9736-f5696eed878b req-5697c198-d63b-44cf-a720-61450bf29a5f service nova] Creating event network-vif-plugged:dc3ec772-1aa6-40c5-a783-9c70e0e921dd for instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a on hv-cinder-85032 Jul 21 08:33:10.924206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-6e88621e-d443-4dcd-9736-f5696eed878b req-5697c198-d63b-44cf-a720-61450bf29a5f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070997 Jul 21 08:33:10.926571 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 199/384] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:10.936874 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-10df7d52-766d-4422-864d-00e5b082da35 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:10.949797 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-10df7d52-766d-4422-864d-00e5b082da35 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:10.997620 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10df7d52-766d-4422-864d-00e5b082da35 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:10.998074 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10df7d52-766d-4422-864d-00e5b082da35 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:10.998866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10df7d52-766d-4422-864d-00e5b082da35 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:10.999302 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10df7d52-766d-4422-864d-00e5b082da35 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:11.459120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-10df7d52-766d-4422-864d-00e5b082da35 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:11.469918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-10df7d52-766d-4422-864d-00e5b082da35 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.538883 Jul 21 08:33:11.470668 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 200/385] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:10 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:11.600081 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a07d06a4-acda-469d-9009-202bed90ac60 req-28557a27-df46-47d5-a735-8315880702bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1747f3-79a3-4e2d-bda8-49fec0b5018a", "tag": "ef56d972-ef7d-4c22-ae07-b6fd0167acb2"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:11.613347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a07d06a4-acda-469d-9009-202bed90ac60 req-28557a27-df46-47d5-a735-8315880702bb service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:11.613798 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a07d06a4-acda-469d-9009-202bed90ac60 req-28557a27-df46-47d5-a735-8315880702bb service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:11.665013 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a07d06a4-acda-469d-9009-202bed90ac60 req-28557a27-df46-47d5-a735-8315880702bb service nova] Creating event network-changed:ef56d972-ef7d-4c22-ae07-b6fd0167acb2 for instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a on hv-cinder-85032 Jul 21 08:33:11.681584 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a07d06a4-acda-469d-9009-202bed90ac60 req-28557a27-df46-47d5-a735-8315880702bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085038 Jul 21 08:33:11.682398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 201/386] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:33:11.860299 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:11.861262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:11.873752 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:11.876617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:11.877677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:11.881731 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:12.237606 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:12.251513 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:12.256180 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:12.270682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3b293fbe-e847-4194-be8b-bdff17373466 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.415540 Jul 21 08:33:12.273741 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 202/387] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:11 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:12.497681 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7341f1bf-1daf-46bf-9b2f-b6db2dac982e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:12.498487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7341f1bf-1daf-46bf-9b2f-b6db2dac982e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:12.508958 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7341f1bf-1daf-46bf-9b2f-b6db2dac982e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:12.520590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:12.525699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7341f1bf-1daf-46bf-9b2f-b6db2dac982e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:12.526754 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7341f1bf-1daf-46bf-9b2f-b6db2dac982e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:12.527352 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7341f1bf-1daf-46bf-9b2f-b6db2dac982e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:12.554622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=10 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:12.846780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:12.885448 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7341f1bf-1daf-46bf-9b2f-b6db2dac982e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:12.895549 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7341f1bf-1daf-46bf-9b2f-b6db2dac982e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.403947 Jul 21 08:33:12.897447 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 203/388] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:12 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:13.292621 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:13.293236 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:13.305342 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:13.305790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:13.306609 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:13.307042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:13.876390 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:13.886782 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:13.888783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:13.890425 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7aeb73bb-285b-4a7a-aede-e63f1d482cdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.602705 Jul 21 08:33:13.917594 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 204/389] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:13 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:13.938256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b38c888d-8290-47c5-8e31-216d0b549040 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:13.939061 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b38c888d-8290-47c5-8e31-216d0b549040 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:13.951423 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b38c888d-8290-47c5-8e31-216d0b549040 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:13.952143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b38c888d-8290-47c5-8e31-216d0b549040 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:13.953128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b38c888d-8290-47c5-8e31-216d0b549040 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:13.953731 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b38c888d-8290-47c5-8e31-216d0b549040 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:14.318508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b38c888d-8290-47c5-8e31-216d0b549040 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:14.334025 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b38c888d-8290-47c5-8e31-216d0b549040 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.403566 Jul 21 08:33:14.334628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 205/390] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:13 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:14.909871 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:14.910558 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:14.926329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:14.927023 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:14.935287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:14.935714 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:15.211690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:15.222440 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:15.224953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:15.227050 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d39c7ef5-7a9b-4d52-b48b-699417d943c4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.321170 Jul 21 08:33:15.240601 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 206/391] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:14 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:15.350569 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-601013dc-7bf3-4384-a41e-42487c4b7b64 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:15.351200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-601013dc-7bf3-4384-a41e-42487c4b7b64 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:15.353257 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:15.369901 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-601013dc-7bf3-4384-a41e-42487c4b7b64 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:15.370687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-601013dc-7bf3-4384-a41e-42487c4b7b64 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:15.374917 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-601013dc-7bf3-4384-a41e-42487c4b7b64 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:15.380057 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-601013dc-7bf3-4384-a41e-42487c4b7b64 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:15.658479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-601013dc-7bf3-4384-a41e-42487c4b7b64 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:15.667923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-601013dc-7bf3-4384-a41e-42487c4b7b64 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.321521 Jul 21 08:33:15.669514 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 207/392] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:15 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:16.251589 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:16.253127 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:16.267016 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:16.267892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:16.269806 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:16.273004 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:16.629014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:16.639343 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:16.645046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:16.646293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-76c66488-fe1b-4b35-be28-fafda29fd484 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.404152 Jul 21 08:33:16.647130 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 208/393] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:16 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:16.691434 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7033ffc-83bb-41bf-816e-8fc86808f41a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:16.691434 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a7033ffc-83bb-41bf-816e-8fc86808f41a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:16.726603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7033ffc-83bb-41bf-816e-8fc86808f41a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:16.728412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7033ffc-83bb-41bf-816e-8fc86808f41a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:16.729112 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7033ffc-83bb-41bf-816e-8fc86808f41a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:16.729557 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7033ffc-83bb-41bf-816e-8fc86808f41a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:17.387359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7033ffc-83bb-41bf-816e-8fc86808f41a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:17.405452 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a7033ffc-83bb-41bf-816e-8fc86808f41a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.723156 Jul 21 08:33:17.406763 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 209/394] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:16 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:17.667301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:17.668325 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:17.686408 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:17.687441 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:17.694034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:17.696807 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:17.973476 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:17.987786 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:17.989492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:17.991378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4745409f-8c0e-471d-b368-b4400c5e1741 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.328892 Jul 21 08:33:18.010782 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 210/395] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:17 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:18.425903 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb11da50-05e0-4b90-bdbb-eed7727bd55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:18.426605 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cb11da50-05e0-4b90-bdbb-eed7727bd55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:18.436522 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] validate_networks() for [('3d7d50f4-aa56-4ed9-ae9c-589f9803dd64', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:33:18.440982 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb11da50-05e0-4b90-bdbb-eed7727bd55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:18.441436 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb11da50-05e0-4b90-bdbb-eed7727bd55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:18.442213 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb11da50-05e0-4b90-bdbb-eed7727bd55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:18.442649 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb11da50-05e0-4b90-bdbb-eed7727bd55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:18.798369 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cb11da50-05e0-4b90-bdbb-eed7727bd55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:18.807280 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cb11da50-05e0-4b90-bdbb-eed7727bd55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.387968 Jul 21 08:33:18.815648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 211/396] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:18 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:19.015893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:19.017007 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:19.026829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:19.028167 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:19.033918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:19.034690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:19.301679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:19.327188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:19.329224 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:19.333142 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bcbf00c1-d18a-487b-a0c4-529697719396 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.324114 Jul 21 08:33:19.336136 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=68 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:19.352533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 212/397] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:19 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:19.582317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:19.753907 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:33:19.754582 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:33:19.755280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:33:19.755971 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:33:19.756608 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:33:19.788406 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:19.798425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:19.799899 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:19.800911 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:19.824951 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cfb4f02d-6f50-4aee-83ca-0b380e028b94 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:19.825753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cfb4f02d-6f50-4aee-83ca-0b380e028b94 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:19.834239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfb4f02d-6f50-4aee-83ca-0b380e028b94 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:19.834822 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfb4f02d-6f50-4aee-83ca-0b380e028b94 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:19.835709 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfb4f02d-6f50-4aee-83ca-0b380e028b94 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:19.836209 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfb4f02d-6f50-4aee-83ca-0b380e028b94 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:19.841880 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:19.891646 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Getting quotas for project 419b6c6707544364b82f3f6fb5030032. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:33:19.906830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Getting quotas for user 1f914243baf846f5b43a929332bcef6e and project 419b6c6707544364b82f3f6fb5030032. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:33:19.959197 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:33:19.963783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:33:20.128300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cfb4f02d-6f50-4aee-83ca-0b380e028b94 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:20.139817 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cfb4f02d-6f50-4aee-83ca-0b380e028b94 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.317355 Jul 21 08:33:20.141121 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 213/398] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:19 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:20.154264 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5685f5ff-43c1-4f68-a827-c7f228b9e214 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.609507 Jul 21 08:33:20.156151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 186/399] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:33:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 10613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 08:33:20.167675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b3c57a14-5f3c-4245-9103-fb15d0bd3f61 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:20.169053 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b3c57a14-5f3c-4245-9103-fb15d0bd3f61 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:20.263720 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b3c57a14-5f3c-4245-9103-fb15d0bd3f61 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:20.272089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b3c57a14-5f3c-4245-9103-fb15d0bd3f61 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1218 microversion: 2.1 time: 0.109793 Jul 21 08:33:20.274683 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 214/400] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:20 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:20.361651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:20.362789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:20.376711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:20.382522 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:20.389177 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:20.390326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:20.680693 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:20.693514 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:20.700244 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:20.701850 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-78b425ea-41bb-4f1d-bc41-a0ef09ee6928 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.346633 Jul 21 08:33:20.702924 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 187/401] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:20 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:21.157976 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e798633b-560e-4fdd-98b4-973d8da33a27 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:21.158645 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e798633b-560e-4fdd-98b4-973d8da33a27 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:21.168921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e798633b-560e-4fdd-98b4-973d8da33a27 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:21.172672 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e798633b-560e-4fdd-98b4-973d8da33a27 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:21.176380 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e798633b-560e-4fdd-98b4-973d8da33a27 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:21.179462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e798633b-560e-4fdd-98b4-973d8da33a27 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:21.289910 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1db051a3-53fb-42fa-9349-dee3946a5135 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:21.291436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1db051a3-53fb-42fa-9349-dee3946a5135 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:21.308691 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1db051a3-53fb-42fa-9349-dee3946a5135 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:21.309732 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1db051a3-53fb-42fa-9349-dee3946a5135 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:21.310697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1db051a3-53fb-42fa-9349-dee3946a5135 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:21.311286 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1db051a3-53fb-42fa-9349-dee3946a5135 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:21.475448 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e798633b-560e-4fdd-98b4-973d8da33a27 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:21.488964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e798633b-560e-4fdd-98b4-973d8da33a27 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.332970 Jul 21 08:33:21.490031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1db051a3-53fb-42fa-9349-dee3946a5135 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:21.497877 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1db051a3-53fb-42fa-9349-dee3946a5135 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1214 microversion: 2.1 time: 0.211693 Jul 21 08:33:21.500437 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 215/402] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:21 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:21.501514 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 188/403] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:21 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:21.729066 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:21.730074 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:21.737020 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:21.737712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:21.738656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:21.739281 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:22.183766 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:22.206665 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:22.206665 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:22.214601 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b2dd7dec-d737-4a48-abd5-bfa01d0d247a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.497661 Jul 21 08:33:22.229196 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 216/404] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:21 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:22.506848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3513ce66-0f79-4820-aaa9-2cc592362053 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:22.508241 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3513ce66-0f79-4820-aaa9-2cc592362053 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:22.518617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5e986d7f-8838-4001-87d6-12e9cea50ce1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:22.519232 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5e986d7f-8838-4001-87d6-12e9cea50ce1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:22.519473 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3513ce66-0f79-4820-aaa9-2cc592362053 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:22.519899 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3513ce66-0f79-4820-aaa9-2cc592362053 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:22.520681 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3513ce66-0f79-4820-aaa9-2cc592362053 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:22.521111 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3513ce66-0f79-4820-aaa9-2cc592362053 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:22.526011 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e986d7f-8838-4001-87d6-12e9cea50ce1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:22.530899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e986d7f-8838-4001-87d6-12e9cea50ce1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:22.532601 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e986d7f-8838-4001-87d6-12e9cea50ce1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:22.533162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e986d7f-8838-4001-87d6-12e9cea50ce1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:22.800910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5e986d7f-8838-4001-87d6-12e9cea50ce1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:22.815968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5e986d7f-8838-4001-87d6-12e9cea50ce1 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1276 microversion: 2.1 time: 0.301500 Jul 21 08:33:22.816717 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 217/405] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:22 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1276 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:22.866656 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3513ce66-0f79-4820-aaa9-2cc592362053 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:22.877327 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3513ce66-0f79-4820-aaa9-2cc592362053 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.374586 Jul 21 08:33:22.883670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 189/406] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:22 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:23.244851 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:23.245398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:23.266640 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:23.271299 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:23.280042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:23.284015 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:23.604412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:23.619558 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:23.622300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:23.624451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7b8c49e6-4f73-48fb-903a-a576fded8f28 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.383532 Jul 21 08:33:23.625919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 218/407] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:23 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:23.836094 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1508f68-add2-43bd-b831-63b62ab9e9fa tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:23.838037 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1508f68-add2-43bd-b831-63b62ab9e9fa tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:23.845989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1508f68-add2-43bd-b831-63b62ab9e9fa tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:23.846824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1508f68-add2-43bd-b831-63b62ab9e9fa tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:23.847881 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1508f68-add2-43bd-b831-63b62ab9e9fa tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:23.849215 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1508f68-add2-43bd-b831-63b62ab9e9fa tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:23.904237 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-985fce44-8f57-420d-85b5-9527b0bf63a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:23.905888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-985fce44-8f57-420d-85b5-9527b0bf63a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:23.918129 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-985fce44-8f57-420d-85b5-9527b0bf63a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:23.918966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-985fce44-8f57-420d-85b5-9527b0bf63a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:23.920076 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-985fce44-8f57-420d-85b5-9527b0bf63a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:23.920758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-985fce44-8f57-420d-85b5-9527b0bf63a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:24.075420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1508f68-add2-43bd-b831-63b62ab9e9fa tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:24.092084 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1508f68-add2-43bd-b831-63b62ab9e9fa tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.261755 Jul 21 08:33:24.104292 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 190/408] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:23 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:24.303088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-985fce44-8f57-420d-85b5-9527b0bf63a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:24.318699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-985fce44-8f57-420d-85b5-9527b0bf63a6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.422878 Jul 21 08:33:24.320006 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 219/409] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:23 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:24.611709 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-cd1b484b-2707-4212-80b0-5e55fbf68a4f req-3e37ca32-d6ee-45ec-a2bc-d32450738be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b779892e-87e8-4dd0-b428-4bf2a76ed929", "tag": "ee477da8-7dc9-4256-98da-c956095c6475"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:24.650976 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:24.651965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:24.663395 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cd1b484b-2707-4212-80b0-5e55fbf68a4f req-3e37ca32-d6ee-45ec-a2bc-d32450738be9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:24.663864 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cd1b484b-2707-4212-80b0-5e55fbf68a4f req-3e37ca32-d6ee-45ec-a2bc-d32450738be9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:24.669383 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:24.670630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:24.675061 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:24.677001 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:24.707390 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-cd1b484b-2707-4212-80b0-5e55fbf68a4f req-3e37ca32-d6ee-45ec-a2bc-d32450738be9 service nova] Creating event network-changed:ee477da8-7dc9-4256-98da-c956095c6475 for instance b779892e-87e8-4dd0-b428-4bf2a76ed929 on hv-cinder-85032 Jul 21 08:33:24.717390 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-cd1b484b-2707-4212-80b0-5e55fbf68a4f req-3e37ca32-d6ee-45ec-a2bc-d32450738be9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109952 Jul 21 08:33:24.718648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 191/410] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:24.904461 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-8f6ecaf3-7474-4316-8b2b-814a9f15eb95 req-b773b39b-aa4f-49ea-8bd5-2621985cd511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1747f3-79a3-4e2d-bda8-49fec0b5018a", "name": "network-vif-plugged", "status": "completed", "tag": "ef56d972-ef7d-4c22-ae07-b6fd0167acb2"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:24.926761 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-8f6ecaf3-7474-4316-8b2b-814a9f15eb95 req-b773b39b-aa4f-49ea-8bd5-2621985cd511 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:24.930892 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-8f6ecaf3-7474-4316-8b2b-814a9f15eb95 req-b773b39b-aa4f-49ea-8bd5-2621985cd511 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:24.968582 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-8f6ecaf3-7474-4316-8b2b-814a9f15eb95 req-b773b39b-aa4f-49ea-8bd5-2621985cd511 service nova] Creating event network-vif-plugged:ef56d972-ef7d-4c22-ae07-b6fd0167acb2 for instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a on hv-cinder-85032 Jul 21 08:33:24.990783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-8f6ecaf3-7474-4316-8b2b-814a9f15eb95 req-b773b39b-aa4f-49ea-8bd5-2621985cd511 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095634 Jul 21 08:33:24.997799 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 192/411] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:33:25.110710 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0989c856-2508-46b7-974e-ea24bf1b4f17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:25.111850 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0989c856-2508-46b7-974e-ea24bf1b4f17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:25.143007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0989c856-2508-46b7-974e-ea24bf1b4f17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:25.155989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0989c856-2508-46b7-974e-ea24bf1b4f17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:25.159564 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0989c856-2508-46b7-974e-ea24bf1b4f17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:25.160248 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0989c856-2508-46b7-974e-ea24bf1b4f17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:25.178796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:25.193784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:25.201434 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:25.220465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-46eb6308-7b19-4b26-a021-1de6edf90a39 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.574178 Jul 21 08:33:25.221866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 220/412] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:24 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:25.336985 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5d0f0c74-6f7f-40d9-9f17-e09b6a7427a5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:25.337602 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5d0f0c74-6f7f-40d9-9f17-e09b6a7427a5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:25.363967 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d0f0c74-6f7f-40d9-9f17-e09b6a7427a5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:25.364743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d0f0c74-6f7f-40d9-9f17-e09b6a7427a5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:25.365868 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d0f0c74-6f7f-40d9-9f17-e09b6a7427a5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:25.367623 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d0f0c74-6f7f-40d9-9f17-e09b6a7427a5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:25.531267 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0989c856-2508-46b7-974e-ea24bf1b4f17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:25.539697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0989c856-2508-46b7-974e-ea24bf1b4f17 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.434995 Jul 21 08:33:25.542328 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 193/413] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:25 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:25.752162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5d0f0c74-6f7f-40d9-9f17-e09b6a7427a5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:25.772864 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5d0f0c74-6f7f-40d9-9f17-e09b6a7427a5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.440760 Jul 21 08:33:25.773524 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 221/414] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:25 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:26.243925 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:26.244616 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:26.292945 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:26.307066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:26.310070 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:26.315260 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:26.557595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-06cdc77c-3f5d-485d-862f-e23eb978b0b8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:26.558302 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-06cdc77c-3f5d-485d-862f-e23eb978b0b8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:26.577772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06cdc77c-3f5d-485d-862f-e23eb978b0b8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:26.578482 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06cdc77c-3f5d-485d-862f-e23eb978b0b8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:26.579286 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06cdc77c-3f5d-485d-862f-e23eb978b0b8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:26.597663 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06cdc77c-3f5d-485d-862f-e23eb978b0b8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:26.647773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:26.660045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:26.662133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:26.663606 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-31d97019-b8c0-4c8a-b6a1-ba1b79c9d636 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.427209 Jul 21 08:33:26.664881 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 194/415] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:26 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:26.792049 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-540caa6b-afef-4e7a-b32d-e98c3a5869a2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:26.793006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-540caa6b-afef-4e7a-b32d-e98c3a5869a2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:26.804312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-540caa6b-afef-4e7a-b32d-e98c3a5869a2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:26.805075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-540caa6b-afef-4e7a-b32d-e98c3a5869a2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:26.808711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-540caa6b-afef-4e7a-b32d-e98c3a5869a2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:26.809398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-540caa6b-afef-4e7a-b32d-e98c3a5869a2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:27.144441 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-06cdc77c-3f5d-485d-862f-e23eb978b0b8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:27.171662 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-06cdc77c-3f5d-485d-862f-e23eb978b0b8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.618346 Jul 21 08:33:27.172909 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 222/416] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:26 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:27.194672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-540caa6b-afef-4e7a-b32d-e98c3a5869a2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:27.205550 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-540caa6b-afef-4e7a-b32d-e98c3a5869a2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1371 microversion: 2.1 time: 0.418207 Jul 21 08:33:27.229888 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 195/417] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:26 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1371 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:27.682935 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:27.683533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:27.690298 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:27.691000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:27.692034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:27.692629 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:27.916813 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:27.930585 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:27.933117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:27.934255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-35e02570-71f9-4ea3-a49e-fcedbe7f2638 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.256111 Jul 21 08:33:27.935576 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 223/418] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:27 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:28.189744 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e5888c6a-f029-4e5e-a994-35c26f15d738 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:28.190323 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e5888c6a-f029-4e5e-a994-35c26f15d738 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:28.197149 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5888c6a-f029-4e5e-a994-35c26f15d738 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:28.198193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5888c6a-f029-4e5e-a994-35c26f15d738 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:28.198962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5888c6a-f029-4e5e-a994-35c26f15d738 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:28.199412 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5888c6a-f029-4e5e-a994-35c26f15d738 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:28.230953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c4bac36e-054a-4d5a-9e77-0e53faed9240 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:28.231595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c4bac36e-054a-4d5a-9e77-0e53faed9240 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:28.242950 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4bac36e-054a-4d5a-9e77-0e53faed9240 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:28.243966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4bac36e-054a-4d5a-9e77-0e53faed9240 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:28.244696 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4bac36e-054a-4d5a-9e77-0e53faed9240 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:28.245129 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4bac36e-054a-4d5a-9e77-0e53faed9240 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:28.476037 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e5888c6a-f029-4e5e-a994-35c26f15d738 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:28.486882 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e5888c6a-f029-4e5e-a994-35c26f15d738 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.301528 Jul 21 08:33:28.489050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 196/419] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:28 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:28.535860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c4bac36e-054a-4d5a-9e77-0e53faed9240 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:28.548294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c4bac36e-054a-4d5a-9e77-0e53faed9240 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1565 microversion: 2.1 time: 0.321318 Jul 21 08:33:28.549375 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 224/420] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:28 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1565 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:28.567809 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd17290f-2e00-4c03-983d-bf146593c9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:28.568418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd17290f-2e00-4c03-983d-bf146593c9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:28.575539 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd17290f-2e00-4c03-983d-bf146593c9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:28.576058 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd17290f-2e00-4c03-983d-bf146593c9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:28.576902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd17290f-2e00-4c03-983d-bf146593c9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:28.577402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd17290f-2e00-4c03-983d-bf146593c9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:28.700216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd17290f-2e00-4c03-983d-bf146593c9dd tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136176 Jul 21 08:33:28.704043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 197/421] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 21 08:33:28 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:28.955370 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:28.956903 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:28.974577 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:28.978977 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:28.980057 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:28.981579 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:29.506941 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:29.507624 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ea924d8a-0173-4ca7-9dd1-e390d999c0e6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:29.508452 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ea924d8a-0173-4ca7-9dd1-e390d999c0e6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:29.518853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:29.524656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:29.525901 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8558f81a-1313-4831-8d61-44f146e114e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.577466 Jul 21 08:33:29.526670 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 225/422] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:28 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:29.532448 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea924d8a-0173-4ca7-9dd1-e390d999c0e6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:29.533059 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea924d8a-0173-4ca7-9dd1-e390d999c0e6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:29.533910 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea924d8a-0173-4ca7-9dd1-e390d999c0e6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:29.539392 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea924d8a-0173-4ca7-9dd1-e390d999c0e6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:29.829773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ea924d8a-0173-4ca7-9dd1-e390d999c0e6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:29.839221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ea924d8a-0173-4ca7-9dd1-e390d999c0e6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.337013 Jul 21 08:33:29.841108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 198/423] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:29 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:30.397748 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-cac38787-05d6-4613-90de-46b6d1f4dab9 req-fd472bc9-b52d-42db-8cbf-a31cae3a4507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1747f3-79a3-4e2d-bda8-49fec0b5018a", "tag": "ef56d972-ef7d-4c22-ae07-b6fd0167acb2"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:30.403831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:30.421660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-cac38787-05d6-4613-90de-46b6d1f4dab9 req-fd472bc9-b52d-42db-8cbf-a31cae3a4507 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:30.422875 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-cac38787-05d6-4613-90de-46b6d1f4dab9 req-fd472bc9-b52d-42db-8cbf-a31cae3a4507 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:30.451888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-cac38787-05d6-4613-90de-46b6d1f4dab9 req-fd472bc9-b52d-42db-8cbf-a31cae3a4507 service nova] Creating event network-changed:ef56d972-ef7d-4c22-ae07-b6fd0167acb2 for instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a on hv-cinder-85032 Jul 21 08:33:30.458012 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-cac38787-05d6-4613-90de-46b6d1f4dab9 req-fd472bc9-b52d-42db-8cbf-a31cae3a4507 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063963 Jul 21 08:33:30.466922 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 226/424] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:30.545407 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:30.546661 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:30.556405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:30.558705 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:30.563894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:30.567068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:30.568705 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:30.569319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:30.860143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-40822e08-eaa7-4a78-9fc6-c9610344b685 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:30.860143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-40822e08-eaa7-4a78-9fc6-c9610344b685 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:30.891262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40822e08-eaa7-4a78-9fc6-c9610344b685 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:30.891262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40822e08-eaa7-4a78-9fc6-c9610344b685 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:30.892420 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40822e08-eaa7-4a78-9fc6-c9610344b685 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:30.892960 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40822e08-eaa7-4a78-9fc6-c9610344b685 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:30.921299 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:30.983041 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:30.984707 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:30.985935 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1983acb2-f76d-43e8-858f-9bd8997394cf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.445450 Jul 21 08:33:30.997629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 199/425] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:30 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:31.452860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-40822e08-eaa7-4a78-9fc6-c9610344b685 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:31.464091 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-40822e08-eaa7-4a78-9fc6-c9610344b685 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.611357 Jul 21 08:33:31.481407 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 227/426] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:30 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:32.005529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:32.007043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:32.049283 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:32.050246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:32.051405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:32.051996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:32.225971 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-23221d2e-cd23-4418-ba9d-2edcfc3670d8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Action: 'create', calling method: .version_select at 0x7f65bce55160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-516647709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAqUrRSWVpNisy6EYubzipyMvfv+2Ifk+rLI2EcOUvpJH7hKivQHU/+JOSP6Q+3490dm6iAqLFwZCu77Y66YrXCClN7MKElYZX+w92T3NrQre3julo68AHRLk6qhRj84Q=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:32.278255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-23221d2e-cd23-4418-ba9d-2edcfc3670d8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Getting quotas for project a8ccb394622d4b24930f8b6396671857. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:33:32.286006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:32.288662 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-23221d2e-cd23-4418-ba9d-2edcfc3670d8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Getting quotas for user 8249ebd6b2dc4811ad315d54030d927e and project a8ccb394622d4b24930f8b6396671857. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:33:32.296770 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:32.298905 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:32.300427 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-456400b6-5fa6-44df-ba3f-c38a1f7b64ab tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.299442 Jul 21 08:33:32.301638 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 200/427] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:31 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:32.333164 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-23221d2e-cd23-4418-ba9d-2edcfc3670d8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.111885 Jul 21 08:33:32.334089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 228/428] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:33:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:32.392992 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1278945042", "imageRef": "b317d491-c788-4ff9-b269-b9c1cfdfe610", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-516647709", "networks": [{"uuid": "84f6f6cc-541e-4bf7-878a-e94b99d1f6b1"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:32.447972 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] validate_networks() for [('84f6f6cc-541e-4bf7-878a-e94b99d1f6b1', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:33:32.489764 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-504b31ed-37ec-46e5-9336-7a8a33ba9ef0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:32.490897 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-504b31ed-37ec-46e5-9336-7a8a33ba9ef0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:32.501120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-504b31ed-37ec-46e5-9336-7a8a33ba9ef0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:32.501576 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-504b31ed-37ec-46e5-9336-7a8a33ba9ef0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:32.502665 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-504b31ed-37ec-46e5-9336-7a8a33ba9ef0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:32.503108 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-504b31ed-37ec-46e5-9336-7a8a33ba9ef0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:32.654126 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-504b31ed-37ec-46e5-9336-7a8a33ba9ef0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:32.664773 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-504b31ed-37ec-46e5-9336-7a8a33ba9ef0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.184346 Jul 21 08:33:32.667759 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 229/429] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:32 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:32.910515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:33:32.911014 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:33:32.911580 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:33:32.912061 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:33:32.912598 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:33:32.929962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:32.930494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:32.931562 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:32.932216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:32.951688 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Getting quotas for project a8ccb394622d4b24930f8b6396671857. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:33:32.955687 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Getting quotas for user 8249ebd6b2dc4811ad315d54030d927e and project a8ccb394622d4b24930f8b6396671857. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:33:32.968498 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:33:32.970678 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b317d491-c788-4ff9-b269-b9c1cfdfe610',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:33:33.019420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ed61648d-06ae-439c-a933-a24c795ac01b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630343 Jul 21 08:33:33.020106 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 201/430] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:33:33.030688 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-39caf844-d108-4e1e-a916-d06d3e106ea8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:33.031309 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-39caf844-d108-4e1e-a916-d06d3e106ea8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:33.093465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-39caf844-d108-4e1e-a916-d06d3e106ea8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:33.100521 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-39caf844-d108-4e1e-a916-d06d3e106ea8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1258 microversion: 2.1 time: 0.073843 Jul 21 08:33:33.101575 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 230/431] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:33 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:33.322332 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:33.323259 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:33.343604 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:33.351682 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:33.352861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:33.353464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:33.589505 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:33.598227 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:33.599771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:33.612849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-98694ef8-796c-4656-9102-747dff366bdd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.294929 Jul 21 08:33:33.613725 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 202/432] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:33 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:33.685039 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-af041505-d869-40e1-b568-c26a6931a955 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:33.686324 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-af041505-d869-40e1-b568-c26a6931a955 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:33.696181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af041505-d869-40e1-b568-c26a6931a955 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:33.697378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af041505-d869-40e1-b568-c26a6931a955 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:33.698366 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af041505-d869-40e1-b568-c26a6931a955 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:33.700025 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af041505-d869-40e1-b568-c26a6931a955 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:33.941762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-af041505-d869-40e1-b568-c26a6931a955 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:33.953435 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-af041505-d869-40e1-b568-c26a6931a955 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.273144 Jul 21 08:33:33.964776 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 231/433] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:33 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:34.118394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05515963-f8da-46b1-87ea-8cbb2bc25701 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:34.120493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05515963-f8da-46b1-87ea-8cbb2bc25701 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:34.129104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05515963-f8da-46b1-87ea-8cbb2bc25701 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:34.130086 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05515963-f8da-46b1-87ea-8cbb2bc25701 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:34.131110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05515963-f8da-46b1-87ea-8cbb2bc25701 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:34.131568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05515963-f8da-46b1-87ea-8cbb2bc25701 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:34.218580 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05515963-f8da-46b1-87ea-8cbb2bc25701 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:34.228276 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05515963-f8da-46b1-87ea-8cbb2bc25701 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1310 microversion: 2.1 time: 0.113105 Jul 21 08:33:34.228857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 203/434] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:34 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1310 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:34.635802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:34.637138 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:34.651958 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:34.652752 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:34.654088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:34.654883 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:34.932336 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:34.949217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:34.950962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:34.952793 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7905a45c-1608-47d2-895f-48078c843026 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.324488 Jul 21 08:33:34.953940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 232/435] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:34 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:34.971735 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-25fb8a92-897e-4188-8abf-f65c5c5ad856 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:34.972556 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-25fb8a92-897e-4188-8abf-f65c5c5ad856 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:34.985235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25fb8a92-897e-4188-8abf-f65c5c5ad856 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:34.986661 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25fb8a92-897e-4188-8abf-f65c5c5ad856 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:34.990664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25fb8a92-897e-4188-8abf-f65c5c5ad856 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:34.992862 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25fb8a92-897e-4188-8abf-f65c5c5ad856 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:35.246709 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7ec0cdb8-72fd-4371-9622-aa638ac4b70a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:35.247292 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7ec0cdb8-72fd-4371-9622-aa638ac4b70a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:35.261939 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ec0cdb8-72fd-4371-9622-aa638ac4b70a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:35.263630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ec0cdb8-72fd-4371-9622-aa638ac4b70a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:35.264607 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ec0cdb8-72fd-4371-9622-aa638ac4b70a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:35.265049 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ec0cdb8-72fd-4371-9622-aa638ac4b70a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:35.335407 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:35.401873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-25fb8a92-897e-4188-8abf-f65c5c5ad856 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:35.412927 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-25fb8a92-897e-4188-8abf-f65c5c5ad856 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.445092 Jul 21 08:33:35.432312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 204/436] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:34 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:35.476556 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7ec0cdb8-72fd-4371-9622-aa638ac4b70a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:35.515153 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7ec0cdb8-72fd-4371-9622-aa638ac4b70a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1316 microversion: 2.1 time: 0.272530 Jul 21 08:33:35.516923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 233/437] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:35 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:35.972288 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:35.973177 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:35.981098 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:35.981937 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:35.982901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:35.983516 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:36.007143 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:36.320033 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:36.333239 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:36.335293 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:36.337885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8124e072-ecf0-4739-bb0f-331cf1f50c0a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.369954 Jul 21 08:33:36.339187 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 205/438] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:35 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:36.431700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c094d2ad-8d4d-439a-bfff-e35e04ddacc7 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:36.433242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c094d2ad-8d4d-439a-bfff-e35e04ddacc7 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:36.451261 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c094d2ad-8d4d-439a-bfff-e35e04ddacc7 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:36.452122 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c094d2ad-8d4d-439a-bfff-e35e04ddacc7 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:36.453149 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c094d2ad-8d4d-439a-bfff-e35e04ddacc7 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:36.453802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c094d2ad-8d4d-439a-bfff-e35e04ddacc7 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:36.532747 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2fef2f65-70b7-40be-a184-1b5288b2f56a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:36.533357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2fef2f65-70b7-40be-a184-1b5288b2f56a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:36.548772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fef2f65-70b7-40be-a184-1b5288b2f56a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:36.549227 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fef2f65-70b7-40be-a184-1b5288b2f56a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:36.550008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fef2f65-70b7-40be-a184-1b5288b2f56a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:36.550532 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fef2f65-70b7-40be-a184-1b5288b2f56a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:36.824650 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2fef2f65-70b7-40be-a184-1b5288b2f56a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:36.838351 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2fef2f65-70b7-40be-a184-1b5288b2f56a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.308980 Jul 21 08:33:36.850908 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 206/439] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:36 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:37.147118 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c094d2ad-8d4d-439a-bfff-e35e04ddacc7 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:37.172298 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c094d2ad-8d4d-439a-bfff-e35e04ddacc7 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.743611 Jul 21 08:33:37.183077 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 234/440] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:36 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:37.370663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:37.371296 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:37.387987 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:37.388476 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:37.396108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:37.406455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:37.600155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-961209637", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-853433119", "security_groups": [{"name": "tempest-secgroup-smoke-1365974964"}], "networks": [{"uuid": "76c59feb-7948-400a-b6a5-0292d672de66"}], "block_device_mapping_v2": [{"uuid": "48bf297c-272a-470c-9749-f40d6387bcf8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:37.819628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:37.829965 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:37.842238 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:37.844225 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d6001b91-6a70-4ebb-8c84-e513a2bd23e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.479165 Jul 21 08:33:37.845076 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 207/441] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:37 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:37.854974 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-59fe6219-dcca-4afd-a14d-654f6f77c7a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:37.855973 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-59fe6219-dcca-4afd-a14d-654f6f77c7a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:37.877853 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59fe6219-dcca-4afd-a14d-654f6f77c7a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:37.879533 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59fe6219-dcca-4afd-a14d-654f6f77c7a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:37.882675 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59fe6219-dcca-4afd-a14d-654f6f77c7a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:37.883475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59fe6219-dcca-4afd-a14d-654f6f77c7a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:38.090101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] validate_networks() for [('76c59feb-7948-400a-b6a5-0292d672de66', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:33:38.294361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-59fe6219-dcca-4afd-a14d-654f6f77c7a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:38.327884 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-59fe6219-dcca-4afd-a14d-654f6f77c7a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.476660 Jul 21 08:33:38.328485 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 208/442] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:37 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:38.350153 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b29943d8-ff42-48ed-8712-fb9f04cc69a8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:38.366911 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b29943d8-ff42-48ed-8712-fb9f04cc69a8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:38.397971 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29943d8-ff42-48ed-8712-fb9f04cc69a8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:38.401053 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29943d8-ff42-48ed-8712-fb9f04cc69a8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:38.406873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29943d8-ff42-48ed-8712-fb9f04cc69a8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:38.412208 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29943d8-ff42-48ed-8712-fb9f04cc69a8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:38.693252 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b29943d8-ff42-48ed-8712-fb9f04cc69a8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:38.703409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b29943d8-ff42-48ed-8712-fb9f04cc69a8 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.368702 Jul 21 08:33:38.708130 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 209/443] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:38 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:38.801527 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-f8dc3f50-8c4d-4d11-898c-409665b69f1d req-bab54331-f747-4404-8953-4d7fbb94f9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9611775-7996-4da2-aa8b-5ef9d642cade", "tag": "2d38ba9b-48d8-48b8-bb69-f7ae8db202d3"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:38.835971 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f8dc3f50-8c4d-4d11-898c-409665b69f1d req-bab54331-f747-4404-8953-4d7fbb94f9c1 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:38.836693 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f8dc3f50-8c4d-4d11-898c-409665b69f1d req-bab54331-f747-4404-8953-4d7fbb94f9c1 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:38.858174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-f8dc3f50-8c4d-4d11-898c-409665b69f1d req-bab54331-f747-4404-8953-4d7fbb94f9c1 service nova] Creating event network-changed:2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 for instance e9611775-7996-4da2-aa8b-5ef9d642cade on hv-cinder-85032 Jul 21 08:33:38.870196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-f8dc3f50-8c4d-4d11-898c-409665b69f1d req-bab54331-f747-4404-8953-4d7fbb94f9c1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073851 Jul 21 08:33:38.871092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 210/444] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:33:38.877084 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:38.877811 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:38.886653 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:38.887094 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:38.887898 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:38.888325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:39.360834 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:39.379277 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:39.380319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:39.383048 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6e9b3c70-53ad-4e45-b6b4-7b8be40ed210 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.510819 Jul 21 08:33:39.383741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 211/445] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:38 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:39.395199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-d3b5397e-8359-44f8-9564-13afcf085d5f req-3cd5d713-d920-46a8-9813-a441d4d29137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b779892e-87e8-4dd0-b428-4bf2a76ed929", "name": "network-vif-plugged", "status": "completed", "tag": "ee477da8-7dc9-4256-98da-c956095c6475"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:39.419124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-d3b5397e-8359-44f8-9564-13afcf085d5f req-3cd5d713-d920-46a8-9813-a441d4d29137 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:39.422532 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-d3b5397e-8359-44f8-9564-13afcf085d5f req-3cd5d713-d920-46a8-9813-a441d4d29137 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:39.451558 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-d3b5397e-8359-44f8-9564-13afcf085d5f req-3cd5d713-d920-46a8-9813-a441d4d29137 service nova] Creating event network-vif-plugged:ee477da8-7dc9-4256-98da-c956095c6475 for instance b779892e-87e8-4dd0-b428-4bf2a76ed929 on hv-cinder-85032 Jul 21 08:33:39.460724 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-d3b5397e-8359-44f8-9564-13afcf085d5f req-3cd5d713-d920-46a8-9813-a441d4d29137 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071372 Jul 21 08:33:39.463894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 212/446] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:39.474173 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5659b813-0cb1-48f4-95f7-f043d55b128b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:39.488827 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5659b813-0cb1-48f4-95f7-f043d55b128b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:39.529723 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5659b813-0cb1-48f4-95f7-f043d55b128b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:39.531855 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5659b813-0cb1-48f4-95f7-f043d55b128b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:39.533043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5659b813-0cb1-48f4-95f7-f043d55b128b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:39.534446 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5659b813-0cb1-48f4-95f7-f043d55b128b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:39.620666 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:33:39.622217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:33:39.623243 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:33:39.623951 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:33:39.624537 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:33:39.652124 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:39.652844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:39.654004 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:39.654616 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:39.696782 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Getting quotas for project ccb36757791d463e92faf5dbaa0ff13a. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:33:39.708733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Getting quotas for user 45688a2eafb840e9b2b4c56bbee69375 and project ccb36757791d463e92faf5dbaa0ff13a. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:33:39.885843 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:33:39.890099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48bf297c-272a-470c-9749-f40d6387bcf8',volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:33:39.946890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5659b813-0cb1-48f4-95f7-f043d55b128b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:39.958424 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5659b813-0cb1-48f4-95f7-f043d55b128b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.492979 Jul 21 08:33:39.959834 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 213/447] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:39 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:39.972680 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-97e735ef-0dc9-44a8-82d0-b2ae5566f53d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:39.973551 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-97e735ef-0dc9-44a8-82d0-b2ae5566f53d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:39.988500 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e735ef-0dc9-44a8-82d0-b2ae5566f53d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:39.989394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e735ef-0dc9-44a8-82d0-b2ae5566f53d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:39.990492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e735ef-0dc9-44a8-82d0-b2ae5566f53d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:39.997538 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e735ef-0dc9-44a8-82d0-b2ae5566f53d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:40.258432 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97e735ef-0dc9-44a8-82d0-b2ae5566f53d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:40.269433 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-97e735ef-0dc9-44a8-82d0-b2ae5566f53d tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.308239 Jul 21 08:33:40.283399 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 214/448] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:39 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:40.354538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c292d747-8897-4284-a709-1d4a7081654d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.753414 Jul 21 08:33:40.361023 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 235/449] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:33:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 08:33:40.369775 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-36cd790a-88de-4289-a94f-5b987fec78dc tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:40.372993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-36cd790a-88de-4289-a94f-5b987fec78dc tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:40.402723 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:40.404253 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:40.440353 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:40.443486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:40.455849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:40.457811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:40.522394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-36cd790a-88de-4289-a94f-5b987fec78dc tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:40.530741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-36cd790a-88de-4289-a94f-5b987fec78dc tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1087 microversion: 2.1 time: 0.166137 Jul 21 08:33:40.531355 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 215/450] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:40 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1087 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:40.790331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:40.814219 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:40.817239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:40.824200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d82a1e26-a4a9-4815-bd48-c3b8243a4d79 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.426472 Jul 21 08:33:40.837972 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 236/451] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:40 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:40.984861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-47ae4189-32e3-4880-8c8b-de1e1929d848 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:40.985832 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-47ae4189-32e3-4880-8c8b-de1e1929d848 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:40.993442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-47ae4189-32e3-4880-8c8b-de1e1929d848 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:40.993778 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-47ae4189-32e3-4880-8c8b-de1e1929d848 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:40.995145 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-47ae4189-32e3-4880-8c8b-de1e1929d848 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:40.995784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-47ae4189-32e3-4880-8c8b-de1e1929d848 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:41.289202 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d4d3724c-9950-4095-a157-556493638604 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:41.290910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d4d3724c-9950-4095-a157-556493638604 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:41.304652 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4d3724c-9950-4095-a157-556493638604 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:41.313927 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-47ae4189-32e3-4880-8c8b-de1e1929d848 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:41.320009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4d3724c-9950-4095-a157-556493638604 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:41.322429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4d3724c-9950-4095-a157-556493638604 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:41.331033 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4d3724c-9950-4095-a157-556493638604 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:41.339624 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-47ae4189-32e3-4880-8c8b-de1e1929d848 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.364531 Jul 21 08:33:41.340632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 216/452] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:40 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:41.558167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-418d9c67-5612-4435-b30d-e772aa307e25 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:41.558799 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-418d9c67-5612-4435-b30d-e772aa307e25 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:41.579556 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-418d9c67-5612-4435-b30d-e772aa307e25 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:41.584027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-418d9c67-5612-4435-b30d-e772aa307e25 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:41.585331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-418d9c67-5612-4435-b30d-e772aa307e25 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:41.590021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-418d9c67-5612-4435-b30d-e772aa307e25 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:41.763218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4d3724c-9950-4095-a157-556493638604 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:41.772773 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d4d3724c-9950-4095-a157-556493638604 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.487374 Jul 21 08:33:41.784604 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 237/453] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:41 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:41.799200 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-418d9c67-5612-4435-b30d-e772aa307e25 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:41.808891 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-418d9c67-5612-4435-b30d-e772aa307e25 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1137 microversion: 2.1 time: 0.260130 Jul 21 08:33:41.818357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 217/454] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:41 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1137 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:41.847972 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:41.848674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:41.856004 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:41.856452 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:41.857374 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:41.857814 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:42.122148 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:42.157894 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:42.163195 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:42.165471 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-be24f8c5-4bf0-46d5-9f45-ac182922d405 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.323750 Jul 21 08:33:42.166826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 238/455] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:41 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:42.374196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0caa0542-8930-4273-aac4-95ddcaceb523 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:42.374196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0caa0542-8930-4273-aac4-95ddcaceb523 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:42.374196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0caa0542-8930-4273-aac4-95ddcaceb523 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:42.374196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0caa0542-8930-4273-aac4-95ddcaceb523 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:42.375097 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0caa0542-8930-4273-aac4-95ddcaceb523 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:42.375097 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0caa0542-8930-4273-aac4-95ddcaceb523 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:42.591021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0caa0542-8930-4273-aac4-95ddcaceb523 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:42.599212 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0caa0542-8930-4273-aac4-95ddcaceb523 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.244151 Jul 21 08:33:42.610683 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 218/456] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:42 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:42.792334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-05d73af2-4a70-4919-8ab3-591cbf79cf96 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:42.793406 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-05d73af2-4a70-4919-8ab3-591cbf79cf96 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:42.800508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-05d73af2-4a70-4919-8ab3-591cbf79cf96 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:42.801300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-05d73af2-4a70-4919-8ab3-591cbf79cf96 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:42.802292 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-05d73af2-4a70-4919-8ab3-591cbf79cf96 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:42.802941 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-05d73af2-4a70-4919-8ab3-591cbf79cf96 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:42.831233 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-88331c5e-82fd-4dbb-a86f-7dcf5e9fd822 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:42.831233 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-88331c5e-82fd-4dbb-a86f-7dcf5e9fd822 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:42.843050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88331c5e-82fd-4dbb-a86f-7dcf5e9fd822 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:42.843527 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88331c5e-82fd-4dbb-a86f-7dcf5e9fd822 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:42.849400 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88331c5e-82fd-4dbb-a86f-7dcf5e9fd822 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:42.849880 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88331c5e-82fd-4dbb-a86f-7dcf5e9fd822 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:42.951217 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:42.988687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-05d73af2-4a70-4919-8ab3-591cbf79cf96 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:42.999033 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-05d73af2-4a70-4919-8ab3-591cbf79cf96 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.210431 Jul 21 08:33:43.000439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 239/457] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:42 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:43.026364 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-391322122", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:43.030657 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-88331c5e-82fd-4dbb-a86f-7dcf5e9fd822 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:43.038577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-88331c5e-82fd-4dbb-a86f-7dcf5e9fd822 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1137 microversion: 2.1 time: 0.215831 Jul 21 08:33:43.039348 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 219/458] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:42 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1137 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:43.186132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:43.186905 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:43.192640 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:43.194695 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:43.195170 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:43.196552 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:43.197155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:43.403155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:43.416456 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:43.418016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:43.419894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b5ff61d1-a172-4dd4-9858-571235097704 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.238078 Jul 21 08:33:43.433756 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 220/459] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:43 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:43.618938 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-96f7d67d-afd8-4a1b-82dd-ec5756b26ec5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:43.619673 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-96f7d67d-afd8-4a1b-82dd-ec5756b26ec5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:43.627471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96f7d67d-afd8-4a1b-82dd-ec5756b26ec5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:43.628282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96f7d67d-afd8-4a1b-82dd-ec5756b26ec5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:43.634729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96f7d67d-afd8-4a1b-82dd-ec5756b26ec5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:43.635502 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96f7d67d-afd8-4a1b-82dd-ec5756b26ec5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:43.825291 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-96f7d67d-afd8-4a1b-82dd-ec5756b26ec5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:43.833289 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-96f7d67d-afd8-4a1b-82dd-ec5756b26ec5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.219274 Jul 21 08:33:43.833824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 221/460] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:43 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:44.020175 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-33bf5969-008e-444d-ba7d-eff00a9de8d0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:44.020942 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-33bf5969-008e-444d-ba7d-eff00a9de8d0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:44.032429 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33bf5969-008e-444d-ba7d-eff00a9de8d0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:44.032929 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33bf5969-008e-444d-ba7d-eff00a9de8d0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:44.033771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33bf5969-008e-444d-ba7d-eff00a9de8d0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:44.034268 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33bf5969-008e-444d-ba7d-eff00a9de8d0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:44.225322 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33bf5969-008e-444d-ba7d-eff00a9de8d0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:44.234619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-33bf5969-008e-444d-ba7d-eff00a9de8d0 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.219752 Jul 21 08:33:44.235648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 222/461] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:44 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:44.240370 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e77ec957-bfaf-4e96-9a36-298438148817 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:44.241054 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e77ec957-bfaf-4e96-9a36-298438148817 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:44.251640 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e77ec957-bfaf-4e96-9a36-298438148817 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:44.252173 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e77ec957-bfaf-4e96-9a36-298438148817 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:44.253301 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e77ec957-bfaf-4e96-9a36-298438148817 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:44.255024 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e77ec957-bfaf-4e96-9a36-298438148817 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:44.380814 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e77ec957-bfaf-4e96-9a36-298438148817 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:44.394522 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e77ec957-bfaf-4e96-9a36-298438148817 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1137 microversion: 2.1 time: 0.157678 Jul 21 08:33:44.395314 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 223/462] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:44 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1137 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:44.447295 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:44.451028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:44.459243 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:44.459767 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:44.460544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:44.460981 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:44.488679 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:44.618833 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:44.620620 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] validate_networks() for None {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:33:44.627777 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:44.630079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:44.631643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-01058abf-f262-402a-a913-db4d24611848 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.189142 Jul 21 08:33:44.632668 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 224/463] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:44 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:44.852600 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af2db72b-36e5-495b-930e-85e20234e80f tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:44.853566 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af2db72b-36e5-495b-930e-85e20234e80f tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:44.860460 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af2db72b-36e5-495b-930e-85e20234e80f tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:44.860906 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af2db72b-36e5-495b-930e-85e20234e80f tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:44.861768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af2db72b-36e5-495b-930e-85e20234e80f tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:44.862204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af2db72b-36e5-495b-930e-85e20234e80f tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.027900 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-af2db72b-36e5-495b-930e-85e20234e80f tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:45.038664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af2db72b-36e5-495b-930e-85e20234e80f tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.190686 Jul 21 08:33:45.040640 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 225/464] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:44 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:45.189206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:33:45.189633 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:33:45.190217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:33:45.190629 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:33:45.191055 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:33:45.201128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:45.201593 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.202400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:45.202839 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.220967 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:45.229331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Getting quotas for project 05b859e8bf4847eea99f02efae52cdd1. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:33:45.233974 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Getting quotas for user 1c6e41c41d76488fb71c1b8a5358b637 and project 05b859e8bf4847eea99f02efae52cdd1. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:33:45.249675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:33:45.251793 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c570ff12-d2dd-478f-a654-8a2f5a7543b6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:45.252094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:33:45.252617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c570ff12-d2dd-478f-a654-8a2f5a7543b6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:45.263728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c570ff12-d2dd-478f-a654-8a2f5a7543b6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:45.264402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c570ff12-d2dd-478f-a654-8a2f5a7543b6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.265774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c570ff12-d2dd-478f-a654-8a2f5a7543b6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:45.266294 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c570ff12-d2dd-478f-a654-8a2f5a7543b6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.307802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b532ca06-667e-44f5-aa1b-14f29e13dfba tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.289373 Jul 21 08:33:45.313212 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 240/465] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 08:33:45.324515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0166dccd-aae9-4883-8eb6-c7ac2de6a8bc tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:45.325087 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0166dccd-aae9-4883-8eb6-c7ac2de6a8bc tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:45.411599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0166dccd-aae9-4883-8eb6-c7ac2de6a8bc tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:45.420274 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0166dccd-aae9-4883-8eb6-c7ac2de6a8bc tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1214 microversion: 2.1 time: 0.103925 Jul 21 08:33:45.427387 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 241/466] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:45 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:45.434091 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3ec9983a-0316-43d6-83d0-ebf52ef90b56 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:45.434739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3ec9983a-0316-43d6-83d0-ebf52ef90b56 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:45.463831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ec9983a-0316-43d6-83d0-ebf52ef90b56 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:45.464154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ec9983a-0316-43d6-83d0-ebf52ef90b56 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.464962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ec9983a-0316-43d6-83d0-ebf52ef90b56 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:45.465402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ec9983a-0316-43d6-83d0-ebf52ef90b56 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.498659 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c570ff12-d2dd-478f-a654-8a2f5a7543b6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:45.506729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c570ff12-d2dd-478f-a654-8a2f5a7543b6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.258883 Jul 21 08:33:45.526205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 226/467] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:45 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:45.573681 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3ec9983a-0316-43d6-83d0-ebf52ef90b56 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:45.582068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3ec9983a-0316-43d6-83d0-ebf52ef90b56 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1137 microversion: 2.1 time: 0.159285 Jul 21 08:33:45.582673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 242/468] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:45 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1137 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:45.650816 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:45.651726 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:45.658157 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:45.658823 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.659786 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:45.660361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:45.811879 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:45.823911 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:45.826010 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:45.827374 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51c2c07c-fa7a-4370-9142-150f36b35bc5 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.181232 Jul 21 08:33:45.828313 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 227/469] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:45 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:46.056579 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-75782c6c-e3e2-4205-b89b-8ace4bbb3b32 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:46.058294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-75782c6c-e3e2-4205-b89b-8ace4bbb3b32 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:46.064285 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75782c6c-e3e2-4205-b89b-8ace4bbb3b32 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.065193 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75782c6c-e3e2-4205-b89b-8ace4bbb3b32 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.065957 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75782c6c-e3e2-4205-b89b-8ace4bbb3b32 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.065957 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75782c6c-e3e2-4205-b89b-8ace4bbb3b32 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.205808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-75782c6c-e3e2-4205-b89b-8ace4bbb3b32 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:46.213429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-75782c6c-e3e2-4205-b89b-8ace4bbb3b32 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.160794 Jul 21 08:33:46.214009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 243/470] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:46 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:46.437920 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2d675293-605a-41f1-8a95-62a45b98a224 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:46.438643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d675293-605a-41f1-8a95-62a45b98a224 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:46.444835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d675293-605a-41f1-8a95-62a45b98a224 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.445346 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d675293-605a-41f1-8a95-62a45b98a224 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.446725 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d675293-605a-41f1-8a95-62a45b98a224 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.447144 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d675293-605a-41f1-8a95-62a45b98a224 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.518218 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2d675293-605a-41f1-8a95-62a45b98a224 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:46.524543 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b6252651-577a-4fdd-8731-02e1cfea3f26 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:46.525165 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b6252651-577a-4fdd-8731-02e1cfea3f26 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:46.525928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2d675293-605a-41f1-8a95-62a45b98a224 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1218 microversion: 2.1 time: 0.091693 Jul 21 08:33:46.529089 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 228/471] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:46 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:46.532412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6252651-577a-4fdd-8731-02e1cfea3f26 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.532873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6252651-577a-4fdd-8731-02e1cfea3f26 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.533965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6252651-577a-4fdd-8731-02e1cfea3f26 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.534580 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6252651-577a-4fdd-8731-02e1cfea3f26 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.600686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-85dbe4e4-2cb1-491b-a85e-dcd6302fc0b8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:46.601294 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-85dbe4e4-2cb1-491b-a85e-dcd6302fc0b8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:46.608140 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85dbe4e4-2cb1-491b-a85e-dcd6302fc0b8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.608579 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85dbe4e4-2cb1-491b-a85e-dcd6302fc0b8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.609344 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85dbe4e4-2cb1-491b-a85e-dcd6302fc0b8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.609771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85dbe4e4-2cb1-491b-a85e-dcd6302fc0b8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.687075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-85dbe4e4-2cb1-491b-a85e-dcd6302fc0b8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:46.694884 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-85dbe4e4-2cb1-491b-a85e-dcd6302fc0b8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1137 microversion: 2.1 time: 0.097947 Jul 21 08:33:46.695600 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6252651-577a-4fdd-8731-02e1cfea3f26 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:46.696338 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 229/472] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:46 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1137 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:46.713852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b6252651-577a-4fdd-8731-02e1cfea3f26 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.193096 Jul 21 08:33:46.715044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 244/473] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:46 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:46.846374 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:46.847097 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:46.854200 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.854952 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.855888 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:46.856399 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:46.998384 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:47.006903 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:47.008992 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:47.010247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-34ae9942-3789-4c24-ad36-5240524b6e77 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.168056 Jul 21 08:33:47.011145 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 230/474] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:46 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:47.231582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e3746e0c-802f-4cdb-8d27-c00346eaff00 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:47.232460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e3746e0c-802f-4cdb-8d27-c00346eaff00 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:47.239187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e3746e0c-802f-4cdb-8d27-c00346eaff00 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:47.239662 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e3746e0c-802f-4cdb-8d27-c00346eaff00 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:47.240517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e3746e0c-802f-4cdb-8d27-c00346eaff00 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:47.240949 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e3746e0c-802f-4cdb-8d27-c00346eaff00 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:47.381556 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e3746e0c-802f-4cdb-8d27-c00346eaff00 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:47.389412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e3746e0c-802f-4cdb-8d27-c00346eaff00 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.162787 Jul 21 08:33:47.390084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 245/475] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:47 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:47.542561 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-511ad586-6070-4b9f-a11f-721bae8b4561 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:47.543234 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-511ad586-6070-4b9f-a11f-721bae8b4561 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:47.549508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-511ad586-6070-4b9f-a11f-721bae8b4561 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:47.550042 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-511ad586-6070-4b9f-a11f-721bae8b4561 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:47.550767 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-511ad586-6070-4b9f-a11f-721bae8b4561 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:47.551196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-511ad586-6070-4b9f-a11f-721bae8b4561 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:47.626529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-511ad586-6070-4b9f-a11f-721bae8b4561 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:47.634611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-511ad586-6070-4b9f-a11f-721bae8b4561 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1218 microversion: 2.1 time: 0.096390 Jul 21 08:33:47.635377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 231/476] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:47 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:47.713667 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9dcf52bd-a6be-4384-b635-ead892a340ea tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:47.714406 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9dcf52bd-a6be-4384-b635-ead892a340ea tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:47.720784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dcf52bd-a6be-4384-b635-ead892a340ea tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:47.721229 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dcf52bd-a6be-4384-b635-ead892a340ea tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:47.722098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dcf52bd-a6be-4384-b635-ead892a340ea tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:47.722525 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dcf52bd-a6be-4384-b635-ead892a340ea tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:47.730745 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b35a666-ff42-496d-be28-9671787f8a4b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:47.731692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b35a666-ff42-496d-be28-9671787f8a4b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:47.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b35a666-ff42-496d-be28-9671787f8a4b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:47.738778 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b35a666-ff42-496d-be28-9671787f8a4b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:47.740442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b35a666-ff42-496d-be28-9671787f8a4b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:47.741228 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b35a666-ff42-496d-be28-9671787f8a4b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:47.789163 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9dcf52bd-a6be-4384-b635-ead892a340ea tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:47.797549 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9dcf52bd-a6be-4384-b635-ead892a340ea tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1137 microversion: 2.1 time: 0.088681 Jul 21 08:33:47.798327 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 246/477] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:47 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:47.882418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b35a666-ff42-496d-be28-9671787f8a4b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:47.892364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b35a666-ff42-496d-be28-9671787f8a4b tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.166005 Jul 21 08:33:47.893220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 232/478] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:47 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:48.030469 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:48.031111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:48.037208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.037662 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.038442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.038881 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.177426 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:48.185994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:48.187547 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:48.188819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9f6d42ee-6ac8-456f-99cb-ebede1bdcda8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.162333 Jul 21 08:33:48.189409 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 247/479] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:48 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:48.406916 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ca0c2973-bb7f-489a-95ad-d3c8c345a3c4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:48.407559 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ca0c2973-bb7f-489a-95ad-d3c8c345a3c4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:48.413616 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca0c2973-bb7f-489a-95ad-d3c8c345a3c4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.414061 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca0c2973-bb7f-489a-95ad-d3c8c345a3c4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.414825 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca0c2973-bb7f-489a-95ad-d3c8c345a3c4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.415259 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca0c2973-bb7f-489a-95ad-d3c8c345a3c4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.545484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ca0c2973-bb7f-489a-95ad-d3c8c345a3c4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:48.553084 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ca0c2973-bb7f-489a-95ad-d3c8c345a3c4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.150390 Jul 21 08:33:48.553648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 233/480] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:48 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:48.650638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-453e64c5-31f9-4405-b111-b96b1ff58a77 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:48.651221 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-453e64c5-31f9-4405-b111-b96b1ff58a77 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:48.658049 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-453e64c5-31f9-4405-b111-b96b1ff58a77 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.658486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-453e64c5-31f9-4405-b111-b96b1ff58a77 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.659245 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-453e64c5-31f9-4405-b111-b96b1ff58a77 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.659697 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-453e64c5-31f9-4405-b111-b96b1ff58a77 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.721315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-453e64c5-31f9-4405-b111-b96b1ff58a77 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:48.729135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-453e64c5-31f9-4405-b111-b96b1ff58a77 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1218 microversion: 2.1 time: 0.082349 Jul 21 08:33:48.729694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 248/481] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:48 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:48.814039 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f03fc2c8-0115-4fc8-a088-22fefa56a834 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:48.814568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f03fc2c8-0115-4fc8-a088-22fefa56a834 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:48.820711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f03fc2c8-0115-4fc8-a088-22fefa56a834 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.821156 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f03fc2c8-0115-4fc8-a088-22fefa56a834 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.821919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f03fc2c8-0115-4fc8-a088-22fefa56a834 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.822350 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f03fc2c8-0115-4fc8-a088-22fefa56a834 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.885174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f03fc2c8-0115-4fc8-a088-22fefa56a834 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:48.892813 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f03fc2c8-0115-4fc8-a088-22fefa56a834 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1137 microversion: 2.1 time: 0.082715 Jul 21 08:33:48.893375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 234/482] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:48 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:48.909788 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2974c192-6233-4ca4-bca7-405c22e725dd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:48.910468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2974c192-6233-4ca4-bca7-405c22e725dd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:48.916970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2974c192-6233-4ca4-bca7-405c22e725dd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.917417 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2974c192-6233-4ca4-bca7-405c22e725dd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:48.918181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2974c192-6233-4ca4-bca7-405c22e725dd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:48.918615 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2974c192-6233-4ca4-bca7-405c22e725dd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.053263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2974c192-6233-4ca4-bca7-405c22e725dd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:49.061568 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2974c192-6233-4ca4-bca7-405c22e725dd tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1318 microversion: 2.1 time: 0.155566 Jul 21 08:33:49.062141 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 249/483] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:48 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:49.207634 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:49.208245 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:49.215260 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:49.215843 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.216706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:49.217143 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.380592 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:49.390596 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:49.392126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:49.394101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4e73b56-02cb-49e8-9ab6-a0266796037c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.190460 Jul 21 08:33:49.394654 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 235/484] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:49 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:49.570128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7ded880-eb47-4e16-b0f9-b674ff4075be tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:49.570735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7ded880-eb47-4e16-b0f9-b674ff4075be tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:49.576796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7ded880-eb47-4e16-b0f9-b674ff4075be tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:49.577249 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7ded880-eb47-4e16-b0f9-b674ff4075be tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.578009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7ded880-eb47-4e16-b0f9-b674ff4075be tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:49.578444 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7ded880-eb47-4e16-b0f9-b674ff4075be tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.709213 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7ded880-eb47-4e16-b0f9-b674ff4075be tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:49.716704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7ded880-eb47-4e16-b0f9-b674ff4075be tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.150519 Jul 21 08:33:49.725964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 250/485] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:49 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:49.746732 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-87327108-cf55-4b75-a520-2398dad3dfc8 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:49.747303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-87327108-cf55-4b75-a520-2398dad3dfc8 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:49.755136 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87327108-cf55-4b75-a520-2398dad3dfc8 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:49.755816 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87327108-cf55-4b75-a520-2398dad3dfc8 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.756725 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87327108-cf55-4b75-a520-2398dad3dfc8 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:49.757668 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87327108-cf55-4b75-a520-2398dad3dfc8 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.838957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-87327108-cf55-4b75-a520-2398dad3dfc8 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:49.849253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-87327108-cf55-4b75-a520-2398dad3dfc8 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1218 microversion: 2.1 time: 0.106940 Jul 21 08:33:49.849947 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 236/486] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:49 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:49.908998 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-57088e56-0634-4788-8757-20266fd016a4 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:49.909602 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-57088e56-0634-4788-8757-20266fd016a4 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:49.916221 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57088e56-0634-4788-8757-20266fd016a4 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:49.916661 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57088e56-0634-4788-8757-20266fd016a4 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.917417 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57088e56-0634-4788-8757-20266fd016a4 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:49.917843 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57088e56-0634-4788-8757-20266fd016a4 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:49.987635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57088e56-0634-4788-8757-20266fd016a4 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:49.995112 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-57088e56-0634-4788-8757-20266fd016a4 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1185 microversion: 2.1 time: 0.089987 Jul 21 08:33:49.995720 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 251/487] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:49 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:50.078132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-34b01669-01ea-4f75-872e-046fae46bf7a tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:50.078641 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-34b01669-01ea-4f75-872e-046fae46bf7a tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:50.084904 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34b01669-01ea-4f75-872e-046fae46bf7a tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.085335 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34b01669-01ea-4f75-872e-046fae46bf7a tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.086570 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34b01669-01ea-4f75-872e-046fae46bf7a tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.086989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34b01669-01ea-4f75-872e-046fae46bf7a tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.221143 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34b01669-01ea-4f75-872e-046fae46bf7a tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:50.229994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-34b01669-01ea-4f75-872e-046fae46bf7a tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1507 microversion: 2.1 time: 0.155385 Jul 21 08:33:50.230819 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 237/488] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:50 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:50.246608 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f0242340-6e35-4922-a01e-4e84b14177d6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05c2ca49-acd8-43c8-be26-9f405fab801b", "device": "/dev/sdb"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:50.247885 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f0242340-6e35-4922-a01e-4e84b14177d6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:50.254304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f0242340-6e35-4922-a01e-4e84b14177d6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.254753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f0242340-6e35-4922-a01e-4e84b14177d6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.255651 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f0242340-6e35-4922-a01e-4e84b14177d6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.256209 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f0242340-6e35-4922-a01e-4e84b14177d6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.276017 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:50.414455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:50.415175 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:50.427480 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.428125 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.429612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.429612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.530674 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=8 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:50.577115 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:50.588023 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:50.589544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:50.590707 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3a853482-5a3f-44c9-bac6-1d18831ae49a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1738 microversion: 2.20 time: 0.181197 Jul 21 08:33:50.591280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 238/489] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:50 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:50.733977 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a913468-5230-4bd3-8c91-a73ab4cc9041 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:50.734586 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a913468-5230-4bd3-8c91-a73ab4cc9041 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:50.740791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a913468-5230-4bd3-8c91-a73ab4cc9041 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.741242 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a913468-5230-4bd3-8c91-a73ab4cc9041 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.742090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a913468-5230-4bd3-8c91-a73ab4cc9041 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.743138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a913468-5230-4bd3-8c91-a73ab4cc9041 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.873003 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4a913468-5230-4bd3-8c91-a73ab4cc9041 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:50.880835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a913468-5230-4bd3-8c91-a73ab4cc9041 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.151287 Jul 21 08:33:50.881452 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 239/490] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:50 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:50.886514 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8e53468-d2ea-4eee-ad45-1af5256362b0 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:50.887137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8e53468-d2ea-4eee-ad45-1af5256362b0 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:50.893174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8e53468-d2ea-4eee-ad45-1af5256362b0 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.893611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8e53468-d2ea-4eee-ad45-1af5256362b0 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.894369 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8e53468-d2ea-4eee-ad45-1af5256362b0 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:50.894793 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8e53468-d2ea-4eee-ad45-1af5256362b0 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:50.958740 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8e53468-d2ea-4eee-ad45-1af5256362b0 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:50.966126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8e53468-d2ea-4eee-ad45-1af5256362b0 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1266 microversion: 2.1 time: 0.083735 Jul 21 08:33:50.966696 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 240/491] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:50 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:51.012278 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8cf26787-3cef-4917-88c1-c61285469568 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:51.012887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8cf26787-3cef-4917-88c1-c61285469568 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:51.018919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cf26787-3cef-4917-88c1-c61285469568 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:51.019398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cf26787-3cef-4917-88c1-c61285469568 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:51.020174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cf26787-3cef-4917-88c1-c61285469568 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:51.020609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cf26787-3cef-4917-88c1-c61285469568 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:51.024765 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:51.084395 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8cf26787-3cef-4917-88c1-c61285469568 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:51.091918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8cf26787-3cef-4917-88c1-c61285469568 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1193 microversion: 2.1 time: 0.083381 Jul 21 08:33:51.092489 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 241/492] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:51 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:51.608993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:51.609945 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:51.616872 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:51.617805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:51.618651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:51.619152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:51.647549 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f0242340-6e35-4922-a01e-4e84b14177d6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "POST /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.404527 Jul 21 08:33:51.651363 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 252/493] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:33:50 2022] POST /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929/os-volume_attachments => generated 194 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:51.753870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:51.762465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:51.764038 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:51.765226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5cb0216f-a5af-4b22-bb22-5079371c19ea tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1720 microversion: 2.20 time: 0.160192 Jul 21 08:33:51.765794 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 242/494] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:51 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:51.900588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-16bfff82-89e0-46cf-b1c7-837f24bb695a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:51.901403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-16bfff82-89e0-46cf-b1c7-837f24bb695a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:51.908397 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16bfff82-89e0-46cf-b1c7-837f24bb695a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:51.908977 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16bfff82-89e0-46cf-b1c7-837f24bb695a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:51.909947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16bfff82-89e0-46cf-b1c7-837f24bb695a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:51.910480 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16bfff82-89e0-46cf-b1c7-837f24bb695a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:51.983851 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-70c74968-67bd-4c86-af29-3d0c87597e6c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:51.985216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-70c74968-67bd-4c86-af29-3d0c87597e6c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:52.009078 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70c74968-67bd-4c86-af29-3d0c87597e6c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:52.009429 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70c74968-67bd-4c86-af29-3d0c87597e6c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:52.010217 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70c74968-67bd-4c86-af29-3d0c87597e6c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:52.010646 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70c74968-67bd-4c86-af29-3d0c87597e6c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:52.262206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-16bfff82-89e0-46cf-b1c7-837f24bb695a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:52.272979 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-16bfff82-89e0-46cf-b1c7-837f24bb695a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.378108 Jul 21 08:33:52.290775 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 253/495] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:51 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:52.302588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d5726975-987f-4901-bc79-09e499b53891 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:52.303231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d5726975-987f-4901-bc79-09e499b53891 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:52.311632 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5726975-987f-4901-bc79-09e499b53891 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:52.312195 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5726975-987f-4901-bc79-09e499b53891 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:52.313108 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5726975-987f-4901-bc79-09e499b53891 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:52.313604 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5726975-987f-4901-bc79-09e499b53891 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:52.422729 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d5726975-987f-4901-bc79-09e499b53891 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:52.424862 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-70c74968-67bd-4c86-af29-3d0c87597e6c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:52.446106 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d5726975-987f-4901-bc79-09e499b53891 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1203 microversion: 2.1 time: 0.149671 Jul 21 08:33:52.448273 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 254/496] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:52 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:52.449339 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-70c74968-67bd-4c86-af29-3d0c87597e6c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1284 microversion: 2.1 time: 0.470096 Jul 21 08:33:52.450178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 243/497] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:51 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1284 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:52.785770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:52.786357 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:52.793580 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:52.794346 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:52.795298 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:52.797103 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:53.053291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:53.063098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:53.064640 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:53.066426 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e6075266-c6c8-45a9-a4cd-e21148889a3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1720 microversion: 2.20 time: 0.284599 Jul 21 08:33:53.067387 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 255/498] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:52 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1720 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:53.295214 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9b1429f5-e063-4f3b-9fcc-07d4888617f6 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:53.295944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9b1429f5-e063-4f3b-9fcc-07d4888617f6 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:53.302149 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b1429f5-e063-4f3b-9fcc-07d4888617f6 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:53.302584 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b1429f5-e063-4f3b-9fcc-07d4888617f6 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:53.303372 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b1429f5-e063-4f3b-9fcc-07d4888617f6 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:53.303965 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b1429f5-e063-4f3b-9fcc-07d4888617f6 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:53.469186 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c7aa383e-04f3-4a21-9ea4-b23101aa8f3f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:53.470091 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c7aa383e-04f3-4a21-9ea4-b23101aa8f3f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:53.479103 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c7aa383e-04f3-4a21-9ea4-b23101aa8f3f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:53.479849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c7aa383e-04f3-4a21-9ea4-b23101aa8f3f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:53.480814 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c7aa383e-04f3-4a21-9ea4-b23101aa8f3f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:53.481436 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c7aa383e-04f3-4a21-9ea4-b23101aa8f3f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:53.500062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9b1429f5-e063-4f3b-9fcc-07d4888617f6 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:53.511887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9b1429f5-e063-4f3b-9fcc-07d4888617f6 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.220415 Jul 21 08:33:53.521895 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 244/499] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:53 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:53.527593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-78e5366d-759b-49bd-9864-aac9a88c23be tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:53.528454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-78e5366d-759b-49bd-9864-aac9a88c23be tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:53.535189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78e5366d-759b-49bd-9864-aac9a88c23be tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:53.535700 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78e5366d-759b-49bd-9864-aac9a88c23be tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:53.536477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78e5366d-759b-49bd-9864-aac9a88c23be tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:53.536918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78e5366d-759b-49bd-9864-aac9a88c23be tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:53.656918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c7aa383e-04f3-4a21-9ea4-b23101aa8f3f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:53.671902 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c7aa383e-04f3-4a21-9ea4-b23101aa8f3f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.207389 Jul 21 08:33:53.681832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 256/500] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:53 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:53.794808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a62cec8b-02c5-476c-bd96-a894ccb5aa3c req-2453ad80-7360-4d7c-ae86-1d8f4d86f768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c09729-8625-497c-b28a-fb99327e229e", "tag": "4a25ac86-dd7b-49f3-a64b-cc34f393a6a4"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:53.817089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a62cec8b-02c5-476c-bd96-a894ccb5aa3c req-2453ad80-7360-4d7c-ae86-1d8f4d86f768 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:53.818117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a62cec8b-02c5-476c-bd96-a894ccb5aa3c req-2453ad80-7360-4d7c-ae86-1d8f4d86f768 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:53.827538 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-78e5366d-759b-49bd-9864-aac9a88c23be tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:53.836737 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-78e5366d-759b-49bd-9864-aac9a88c23be tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.312884 Jul 21 08:33:53.843741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 245/501] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:53 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:53.849948 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a62cec8b-02c5-476c-bd96-a894ccb5aa3c req-2453ad80-7360-4d7c-ae86-1d8f4d86f768 service nova] Creating event network-changed:4a25ac86-dd7b-49f3-a64b-cc34f393a6a4 for instance 03c09729-8625-497c-b28a-fb99327e229e on hv-cinder-85032 Jul 21 08:33:53.856159 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a62cec8b-02c5-476c-bd96-a894ccb5aa3c req-2453ad80-7360-4d7c-ae86-1d8f4d86f768 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065118 Jul 21 08:33:53.856793 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 257/502] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:33:54.084312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:54.084923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:54.093856 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.094667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.095605 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.096041 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.230546 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:54.238505 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:54.240042 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:54.241219 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-639c2c22-9d4d-47b6-9486-990a5bb44a4d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1720 microversion: 2.20 time: 0.160816 Jul 21 08:33:54.241779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 246/503] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:54 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:54.529634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-872cd9f8-ed8d-47c7-896f-730418c5d89b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:54.530329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-872cd9f8-ed8d-47c7-896f-730418c5d89b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:54.536703 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-872cd9f8-ed8d-47c7-896f-730418c5d89b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.537155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-872cd9f8-ed8d-47c7-896f-730418c5d89b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.537924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-872cd9f8-ed8d-47c7-896f-730418c5d89b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.538363 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-872cd9f8-ed8d-47c7-896f-730418c5d89b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.673197 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-872cd9f8-ed8d-47c7-896f-730418c5d89b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:54.681267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-872cd9f8-ed8d-47c7-896f-730418c5d89b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.155680 Jul 21 08:33:54.681848 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 258/504] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:54 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:54.689196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-291f1be4-3784-4a83-ba5c-ffab21af7f92 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:54.689810 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-291f1be4-3784-4a83-ba5c-ffab21af7f92 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:54.696428 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-291f1be4-3784-4a83-ba5c-ffab21af7f92 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.696872 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-291f1be4-3784-4a83-ba5c-ffab21af7f92 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.697650 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-291f1be4-3784-4a83-ba5c-ffab21af7f92 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.698082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-291f1be4-3784-4a83-ba5c-ffab21af7f92 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.734693 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-e540e57a-b599-4ae3-bf75-fcbb1e6d00d8 req-9b9557a4-95d3-4154-a313-8cb4f15346e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9611775-7996-4da2-aa8b-5ef9d642cade", "name": "network-vif-plugged", "status": "completed", "tag": "2d38ba9b-48d8-48b8-bb69-f7ae8db202d3"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:54.755344 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e540e57a-b599-4ae3-bf75-fcbb1e6d00d8 req-9b9557a4-95d3-4154-a313-8cb4f15346e9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.757804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e540e57a-b599-4ae3-bf75-fcbb1e6d00d8 req-9b9557a4-95d3-4154-a313-8cb4f15346e9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.772188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-e540e57a-b599-4ae3-bf75-fcbb1e6d00d8 req-9b9557a4-95d3-4154-a313-8cb4f15346e9 service nova] Creating event network-vif-plugged:2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 for instance e9611775-7996-4da2-aa8b-5ef9d642cade on hv-cinder-85032 Jul 21 08:33:54.779943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-e540e57a-b599-4ae3-bf75-fcbb1e6d00d8 req-9b9557a4-95d3-4154-a313-8cb4f15346e9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049911 Jul 21 08:33:54.782143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 259/505] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:54.879709 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3b1d146e-e508-411c-a67d-f68d65baa4c1 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:54.883908 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3b1d146e-e508-411c-a67d-f68d65baa4c1 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:54.921728 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b1d146e-e508-411c-a67d-f68d65baa4c1 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.925519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b1d146e-e508-411c-a67d-f68d65baa4c1 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.930789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b1d146e-e508-411c-a67d-f68d65baa4c1 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:54.931307 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b1d146e-e508-411c-a67d-f68d65baa4c1 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:54.947172 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-291f1be4-3784-4a83-ba5c-ffab21af7f92 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:54.954730 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-291f1be4-3784-4a83-ba5c-ffab21af7f92 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.269324 Jul 21 08:33:54.955578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 247/506] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:54 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:55.216824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:55.235605 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3b1d146e-e508-411c-a67d-f68d65baa4c1 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:55.244092 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3b1d146e-e508-411c-a67d-f68d65baa4c1 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.380666 Jul 21 08:33:55.244789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 260/507] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:54 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:55.259828 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:55.260419 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:55.266476 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:55.266917 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:55.267700 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:55.268126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:55.579856 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:55.589120 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:55.590784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:55.591868 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b93cc9df-05f3-4577-b2da-b1dbed18a030 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1723 microversion: 2.20 time: 0.336106 Jul 21 08:33:55.592434 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 248/508] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:55 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:55.610312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a6baf99-e995-404e-ad8a-e97b729352a7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb9e246e-52b0-440a-bdb8-abbb6de34d48"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:55.612117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a6baf99-e995-404e-ad8a-e97b729352a7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:55.614051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=20 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:55.620151 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a6baf99-e995-404e-ad8a-e97b729352a7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:55.620580 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a6baf99-e995-404e-ad8a-e97b729352a7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:55.622372 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a6baf99-e995-404e-ad8a-e97b729352a7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:55.623067 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a6baf99-e995-404e-ad8a-e97b729352a7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:55.698973 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b9fa8788-adb1-4a1a-a4f7-ec8854f6382b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:55.699617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9fa8788-adb1-4a1a-a4f7-ec8854f6382b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:55.706028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9fa8788-adb1-4a1a-a4f7-ec8854f6382b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:55.706478 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9fa8788-adb1-4a1a-a4f7-ec8854f6382b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:55.708657 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9fa8788-adb1-4a1a-a4f7-ec8854f6382b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:55.708657 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9fa8788-adb1-4a1a-a4f7-ec8854f6382b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:55.994379 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9fa8788-adb1-4a1a-a4f7-ec8854f6382b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:56.002759 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b9fa8788-adb1-4a1a-a4f7-ec8854f6382b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1358 microversion: 2.1 time: 0.308292 Jul 21 08:33:56.003771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 249/509] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:55 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:56.009781 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-203b5c44-71bc-496b-bbaa-6f89c5c004e8 req-2a091f70-1f24-4655-96de-e85a5aa1c862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31", "tag": "3742ae71-e54f-4d63-9987-96d36f194b44"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:56.012013 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a6baf99-e995-404e-ad8a-e97b729352a7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.405673 Jul 21 08:33:56.018038 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 261/510] 10.222.0.47 () {62 vars in 1363 bytes} [Thu Jul 21 08:33:55 2022] POST /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments => generated 188 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:33:56.019478 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4aa4fe20-9c66-421f-9c47-6097fd698696 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:56.020204 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4aa4fe20-9c66-421f-9c47-6097fd698696 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:56.028421 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4aa4fe20-9c66-421f-9c47-6097fd698696 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.028988 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4aa4fe20-9c66-421f-9c47-6097fd698696 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.029946 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4aa4fe20-9c66-421f-9c47-6097fd698696 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.030478 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4aa4fe20-9c66-421f-9c47-6097fd698696 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.031261 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-203b5c44-71bc-496b-bbaa-6f89c5c004e8 req-2a091f70-1f24-4655-96de-e85a5aa1c862 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.033189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-203b5c44-71bc-496b-bbaa-6f89c5c004e8 req-2a091f70-1f24-4655-96de-e85a5aa1c862 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.057026 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-203b5c44-71bc-496b-bbaa-6f89c5c004e8 req-2a091f70-1f24-4655-96de-e85a5aa1c862 service nova] Creating event network-changed:3742ae71-e54f-4d63-9987-96d36f194b44 for instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 on hv-cinder-85032 Jul 21 08:33:56.071983 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-203b5c44-71bc-496b-bbaa-6f89c5c004e8 req-2a091f70-1f24-4655-96de-e85a5aa1c862 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066702 Jul 21 08:33:56.072895 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 250/511] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:33:56.166072 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8018f60f-3b65-4db3-8ecd-817a51a6c0b7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:56.166718 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8018f60f-3b65-4db3-8ecd-817a51a6c0b7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:56.173015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8018f60f-3b65-4db3-8ecd-817a51a6c0b7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.173484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8018f60f-3b65-4db3-8ecd-817a51a6c0b7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.174206 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8018f60f-3b65-4db3-8ecd-817a51a6c0b7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.174637 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8018f60f-3b65-4db3-8ecd-817a51a6c0b7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.176400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4aa4fe20-9c66-421f-9c47-6097fd698696 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:56.184477 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4aa4fe20-9c66-421f-9c47-6097fd698696 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.169653 Jul 21 08:33:56.185346 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 262/512] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:56 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:56.261811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5a224b2c-f9f7-4dce-8b65-f11e985e5c3c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:56.262441 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5a224b2c-f9f7-4dce-8b65-f11e985e5c3c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:56.264832 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8018f60f-3b65-4db3-8ecd-817a51a6c0b7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/action" status: 202 len: 0 microversion: 2.20 time: 0.102932 Jul 21 08:33:56.265545 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 251/513] 10.222.0.47 () {62 vars in 1318 bytes} [Thu Jul 21 08:33:56 2022] POST /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:33:56.274715 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a224b2c-f9f7-4dce-8b65-f11e985e5c3c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.274840 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:56.275065 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a224b2c-f9f7-4dce-8b65-f11e985e5c3c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.275187 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:56.275453 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a224b2c-f9f7-4dce-8b65-f11e985e5c3c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.275899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a224b2c-f9f7-4dce-8b65-f11e985e5c3c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.281155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.281505 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.282423 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.282853 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.503946 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a224b2c-f9f7-4dce-8b65-f11e985e5c3c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:56.510746 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:56.512353 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5a224b2c-f9f7-4dce-8b65-f11e985e5c3c tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.255247 Jul 21 08:33:56.513504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 263/514] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:56 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:56.528882 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:56.532631 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:56.533918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ab427424-4716-447f-a8df-f68fa0e1f613 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1749 microversion: 2.20 time: 0.263581 Jul 21 08:33:56.534588 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 252/515] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:56 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1749 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:56.802082 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-08bb050e-2777-4dc5-a6eb-736b906e89d6 req-f4067bc5-22b1-4e75-9233-b4f2f2242a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a", "name": "network-vif-unplugged", "status": "completed", "tag": "dc3ec772-1aa6-40c5-a783-9c70e0e921dd"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:56.810509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-08bb050e-2777-4dc5-a6eb-736b906e89d6 req-f4067bc5-22b1-4e75-9233-b4f2f2242a92 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:56.811039 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-08bb050e-2777-4dc5-a6eb-736b906e89d6 req-f4067bc5-22b1-4e75-9233-b4f2f2242a92 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:56.822529 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.compute.server_external_events [req-08bb050e-2777-4dc5-a6eb-736b906e89d6 req-f4067bc5-22b1-4e75-9233-b4f2f2242a92 service nova] Unable to find a host for instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a. Dropping event network-vif-unplugged {{(pid=117950) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 08:33:56.823460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-08bb050e-2777-4dc5-a6eb-736b906e89d6 req-f4067bc5-22b1-4e75-9233-b4f2f2242a92 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025355 Jul 21 08:33:56.824056 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 264/516] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 21 08:33:57.026682 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76194b20-13a5-419a-8757-a89d20b1fc82 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:57.027432 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-76194b20-13a5-419a-8757-a89d20b1fc82 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:57.033596 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76194b20-13a5-419a-8757-a89d20b1fc82 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.034133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76194b20-13a5-419a-8757-a89d20b1fc82 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.034994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76194b20-13a5-419a-8757-a89d20b1fc82 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.035524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76194b20-13a5-419a-8757-a89d20b1fc82 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.191598 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-76194b20-13a5-419a-8757-a89d20b1fc82 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.200032 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-76194b20-13a5-419a-8757-a89d20b1fc82 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1548 microversion: 2.1 time: 0.177693 Jul 21 08:33:57.200599 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 253/517] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:57 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:57.202302 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8b827ce2-99aa-4f4d-9845-4991b4bfda1a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:57.202963 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8b827ce2-99aa-4f4d-9845-4991b4bfda1a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:57.210850 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8b827ce2-99aa-4f4d-9845-4991b4bfda1a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.211883 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8b827ce2-99aa-4f4d-9845-4991b4bfda1a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.212731 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8b827ce2-99aa-4f4d-9845-4991b4bfda1a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.213230 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8b827ce2-99aa-4f4d-9845-4991b4bfda1a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.217866 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f6f85f8-39e5-41e9-a4d3-2813ac59a3df tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:57.218726 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f6f85f8-39e5-41e9-a4d3-2813ac59a3df tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:57.225079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f6f85f8-39e5-41e9-a4d3-2813ac59a3df tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.225644 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f6f85f8-39e5-41e9-a4d3-2813ac59a3df tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.226634 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f6f85f8-39e5-41e9-a4d3-2813ac59a3df tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.227164 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f6f85f8-39e5-41e9-a4d3-2813ac59a3df tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.369099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f6f85f8-39e5-41e9-a4d3-2813ac59a3df tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.378211 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f6f85f8-39e5-41e9-a4d3-2813ac59a3df tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1548 microversion: 2.1 time: 0.164414 Jul 21 08:33:57.379205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 254/518] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:57 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:57.392288 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8b827ce2-99aa-4f4d-9845-4991b4bfda1a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.395448 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:57.398986 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.399801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Searching by: {'deleted': False, 'project_id': 'a8ccb394622d4b24930f8b6396671857'} {{(pid=117951) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 08:33:57.400340 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8b827ce2-99aa-4f4d-9845-4991b4bfda1a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.202056 Jul 21 08:33:57.400984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 265/519] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:57 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:57.406666 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.407106 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.407923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.408380 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.501515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.multi_cell_list [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117951) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 08:33:57.529396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ace8c7a4-646a-4c7c-894a-1df5bf773cb4 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:57.530100 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ace8c7a4-646a-4c7c-894a-1df5bf773cb4 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:57.536095 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ace8c7a4-646a-4c7c-894a-1df5bf773cb4 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.536549 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ace8c7a4-646a-4c7c-894a-1df5bf773cb4 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.537317 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ace8c7a4-646a-4c7c-894a-1df5bf773cb4 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.537759 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ace8c7a4-646a-4c7c-894a-1df5bf773cb4 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.596723 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-762498a3-e582-40d1-9000-c43195324315 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205360 Jul 21 08:33:57.597241 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 255/520] 10.222.0.47 () {58 vars in 1124 bytes} [Thu Jul 21 08:33:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:33:57.601886 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:57.602674 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:57.608825 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.609192 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.609964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.610398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.711935 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ace8c7a4-646a-4c7c-894a-1df5bf773cb4 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.719564 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ace8c7a4-646a-4c7c-894a-1df5bf773cb4 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.193979 Jul 21 08:33:57.720139 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 266/521] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:57 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:57.726191 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c2c0f0ca-dd24-45c3-8d55-4f7ac2f65d85 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:57.727600 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c2c0f0ca-dd24-45c3-8d55-4f7ac2f65d85 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:57.734083 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2c0f0ca-dd24-45c3-8d55-4f7ac2f65d85 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.734590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2c0f0ca-dd24-45c3-8d55-4f7ac2f65d85 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.735398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2c0f0ca-dd24-45c3-8d55-4f7ac2f65d85 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:57.735830 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2c0f0ca-dd24-45c3-8d55-4f7ac2f65d85 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:57.740665 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:57.799827 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.809050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.810812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.812008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aff9dabc-e86b-44d4-b2ec-b7addd3cba2b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1749 microversion: 2.20 time: 0.213844 Jul 21 08:33:57.812576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 256/522] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:57 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1749 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:33:57.872014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c2c0f0ca-dd24-45c3-8d55-4f7ac2f65d85 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:57.879958 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c2c0f0ca-dd24-45c3-8d55-4f7ac2f65d85 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1548 microversion: 2.1 time: 0.158808 Jul 21 08:33:57.880541 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 267/523] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:57 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:58.419103 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-120a7fba-412b-4751-b2f4-eef23bbca08f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:58.419738 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-120a7fba-412b-4751-b2f4-eef23bbca08f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:58.427677 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-120a7fba-412b-4751-b2f4-eef23bbca08f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:58.428127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-120a7fba-412b-4751-b2f4-eef23bbca08f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:58.428909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-120a7fba-412b-4751-b2f4-eef23bbca08f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:58.429386 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-120a7fba-412b-4751-b2f4-eef23bbca08f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:58.434379 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:58.573466 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-120a7fba-412b-4751-b2f4-eef23bbca08f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:58.580922 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-120a7fba-412b-4751-b2f4-eef23bbca08f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.167459 Jul 21 08:33:58.581493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 257/524] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:58 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:58.737685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c31700c1-9a1e-47cb-bf0c-e0e96d52223e tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:58.738247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c31700c1-9a1e-47cb-bf0c-e0e96d52223e tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:58.745456 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c31700c1-9a1e-47cb-bf0c-e0e96d52223e tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:58.745905 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c31700c1-9a1e-47cb-bf0c-e0e96d52223e tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:58.746664 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c31700c1-9a1e-47cb-bf0c-e0e96d52223e tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:58.747098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c31700c1-9a1e-47cb-bf0c-e0e96d52223e tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:58.830648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:58.831432 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:58.838107 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:58.838653 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:58.839468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:58.839901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:58.877143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c31700c1-9a1e-47cb-bf0c-e0e96d52223e tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:58.885160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c31700c1-9a1e-47cb-bf0c-e0e96d52223e tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.151479 Jul 21 08:33:58.885743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 268/525] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:58 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:33:58.967031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:58.975445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:58.977617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:58.978752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-222558ce-bee1-4218-9b7d-4a9d64817fda tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1751 microversion: 2.20 time: 0.152137 Jul 21 08:33:58.979313 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 258/526] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:33:58 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:33:59.388055 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-afb1b7ef-40bf-4eed-b1ed-185e45d7e54c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9d425eb-9b07-4512-97c9-290eba2ffd48"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:33:59.389213 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-afb1b7ef-40bf-4eed-b1ed-185e45d7e54c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:59.395240 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-afb1b7ef-40bf-4eed-b1ed-185e45d7e54c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:59.395743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-afb1b7ef-40bf-4eed-b1ed-185e45d7e54c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:59.396503 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-afb1b7ef-40bf-4eed-b1ed-185e45d7e54c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:59.396938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-afb1b7ef-40bf-4eed-b1ed-185e45d7e54c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:59.597999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5475c0e4-d8fb-4018-999d-6cc0fc1b8f53 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:59.598610 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5475c0e4-d8fb-4018-999d-6cc0fc1b8f53 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:59.605258 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5475c0e4-d8fb-4018-999d-6cc0fc1b8f53 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:59.605704 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5475c0e4-d8fb-4018-999d-6cc0fc1b8f53 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:59.606468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5475c0e4-d8fb-4018-999d-6cc0fc1b8f53 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:59.606900 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5475c0e4-d8fb-4018-999d-6cc0fc1b8f53 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:59.737785 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5475c0e4-d8fb-4018-999d-6cc0fc1b8f53 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:33:59.745285 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5475c0e4-d8fb-4018-999d-6cc0fc1b8f53 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.151191 Jul 21 08:33:59.745860 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 259/527] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:59 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:33:59.903235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7e610ae-a7f3-4254-b1d0-d69cb1d51533 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:33:59.904171 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7e610ae-a7f3-4254-b1d0-d69cb1d51533 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:33:59.911070 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7e610ae-a7f3-4254-b1d0-d69cb1d51533 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:59.911754 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7e610ae-a7f3-4254-b1d0-d69cb1d51533 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:33:59.912706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7e610ae-a7f3-4254-b1d0-d69cb1d51533 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:33:59.913207 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7e610ae-a7f3-4254-b1d0-d69cb1d51533 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:00.050141 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-afb1b7ef-40bf-4eed-b1ed-185e45d7e54c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "POST /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665883 Jul 21 08:34:00.051067 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 269/528] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:33:59 2022] POST /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:34:00.056385 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:00.057278 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:00.073557 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:00.074009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:00.074791 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:00.075226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:00.089080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7e610ae-a7f3-4254-b1d0-d69cb1d51533 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:00.098384 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7e610ae-a7f3-4254-b1d0-d69cb1d51533 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.200279 Jul 21 08:34:00.098965 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 260/529] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:33:59 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:00.212469 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:00.220759 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:00.222260 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:00.223445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a7fc08ea-083d-44d9-a997-d55664f5aaa0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1751 microversion: 2.20 time: 0.171408 Jul 21 08:34:00.224001 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 270/530] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:00 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:00.762125 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7a44f5a4-13b8-453d-8b16-613bfccacb83 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:00.762739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7a44f5a4-13b8-453d-8b16-613bfccacb83 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:00.769873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a44f5a4-13b8-453d-8b16-613bfccacb83 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:00.770334 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a44f5a4-13b8-453d-8b16-613bfccacb83 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:00.771094 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a44f5a4-13b8-453d-8b16-613bfccacb83 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:00.771618 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a44f5a4-13b8-453d-8b16-613bfccacb83 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:00.915122 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7a44f5a4-13b8-453d-8b16-613bfccacb83 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:00.922729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7a44f5a4-13b8-453d-8b16-613bfccacb83 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.164503 Jul 21 08:34:00.923305 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 261/531] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:00 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:01.115260 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ef541765-76bf-4926-aa93-66c2f3f19397 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:01.115884 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ef541765-76bf-4926-aa93-66c2f3f19397 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:01.124062 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef541765-76bf-4926-aa93-66c2f3f19397 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:01.124554 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef541765-76bf-4926-aa93-66c2f3f19397 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:01.125412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef541765-76bf-4926-aa93-66c2f3f19397 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:01.125931 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef541765-76bf-4926-aa93-66c2f3f19397 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:01.241442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:01.242356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:01.249059 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:01.249776 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:01.250721 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:01.251399 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:01.269872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef541765-76bf-4926-aa93-66c2f3f19397 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:01.279548 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ef541765-76bf-4926-aa93-66c2f3f19397 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.168022 Jul 21 08:34:01.280737 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 271/532] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:01 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:01.416609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:01.426084 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:01.427686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:01.429225 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f08130c0-232f-4dcf-91da-df13da702196 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.191648 Jul 21 08:34:01.430124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 262/533] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:01 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:01.939439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-885965ab-b3a5-4f7e-b57a-a3c071976298 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:01.939968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-885965ab-b3a5-4f7e-b57a-a3c071976298 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:01.946781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-885965ab-b3a5-4f7e-b57a-a3c071976298 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:01.947223 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-885965ab-b3a5-4f7e-b57a-a3c071976298 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:01.948027 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-885965ab-b3a5-4f7e-b57a-a3c071976298 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:01.948457 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-885965ab-b3a5-4f7e-b57a-a3c071976298 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:02.085060 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-885965ab-b3a5-4f7e-b57a-a3c071976298 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:02.093021 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-885965ab-b3a5-4f7e-b57a-a3c071976298 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.157642 Jul 21 08:34:02.093587 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 272/534] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:01 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:02.299288 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15b8f397-9f0a-48f8-8aef-9fde84b1f5b3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:02.299919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15b8f397-9f0a-48f8-8aef-9fde84b1f5b3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:02.306156 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15b8f397-9f0a-48f8-8aef-9fde84b1f5b3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:02.306620 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15b8f397-9f0a-48f8-8aef-9fde84b1f5b3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:02.307408 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15b8f397-9f0a-48f8-8aef-9fde84b1f5b3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:02.307840 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15b8f397-9f0a-48f8-8aef-9fde84b1f5b3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:02.436676 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-15b8f397-9f0a-48f8-8aef-9fde84b1f5b3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:02.444196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15b8f397-9f0a-48f8-8aef-9fde84b1f5b3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.148652 Jul 21 08:34:02.444700 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 263/535] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:02 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:02.451664 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:02.452296 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:02.458344 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:02.458789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:02.459591 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:02.460027 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:02.595167 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:02.603846 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:02.605358 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:02.606594 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ad431206-3c7f-4e19-a7ad-ff7059137617 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.158848 Jul 21 08:34:02.607180 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 273/536] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:02 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:03.111704 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c8e0cbe9-7a62-4715-84ef-33a11d4ee2a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:03.112789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c8e0cbe9-7a62-4715-84ef-33a11d4ee2a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:03.122543 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8e0cbe9-7a62-4715-84ef-33a11d4ee2a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:03.122986 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8e0cbe9-7a62-4715-84ef-33a11d4ee2a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:03.123790 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8e0cbe9-7a62-4715-84ef-33a11d4ee2a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:03.124225 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8e0cbe9-7a62-4715-84ef-33a11d4ee2a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:03.266070 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8e0cbe9-7a62-4715-84ef-33a11d4ee2a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:03.273701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c8e0cbe9-7a62-4715-84ef-33a11d4ee2a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.167019 Jul 21 08:34:03.274308 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 264/537] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:03 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:03.462644 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f8545077-27c3-4efa-aa28-c1abad749023 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:03.463406 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f8545077-27c3-4efa-aa28-c1abad749023 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:03.470920 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8545077-27c3-4efa-aa28-c1abad749023 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:03.471396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8545077-27c3-4efa-aa28-c1abad749023 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:03.472172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8545077-27c3-4efa-aa28-c1abad749023 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:03.472604 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8545077-27c3-4efa-aa28-c1abad749023 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:03.605040 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f8545077-27c3-4efa-aa28-c1abad749023 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:03.612713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f8545077-27c3-4efa-aa28-c1abad749023 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.154530 Jul 21 08:34:03.613099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 274/538] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:03 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:03.624997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:03.625622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:03.631903 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:03.632344 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:03.633118 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:03.633538 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:03.800410 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:03.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:03.810381 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:03.811558 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d151f1e-ccc4-43bc-ac17-fd185a3c00d0 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.190312 Jul 21 08:34:03.812119 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 265/539] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:03 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:04.290586 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1211905a-fd5c-4979-9c5e-88ee40c3cfe9 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:04.291212 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1211905a-fd5c-4979-9c5e-88ee40c3cfe9 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:04.297480 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1211905a-fd5c-4979-9c5e-88ee40c3cfe9 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:04.298129 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1211905a-fd5c-4979-9c5e-88ee40c3cfe9 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:04.298692 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1211905a-fd5c-4979-9c5e-88ee40c3cfe9 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:04.299131 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1211905a-fd5c-4979-9c5e-88ee40c3cfe9 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:04.629926 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-980ce204-a9fc-4178-b53b-1bdee3850df3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:04.630471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-980ce204-a9fc-4178-b53b-1bdee3850df3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:04.636653 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-980ce204-a9fc-4178-b53b-1bdee3850df3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:04.637094 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-980ce204-a9fc-4178-b53b-1bdee3850df3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:04.637871 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-980ce204-a9fc-4178-b53b-1bdee3850df3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:04.638318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-980ce204-a9fc-4178-b53b-1bdee3850df3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:04.682747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1211905a-fd5c-4979-9c5e-88ee40c3cfe9 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:04.690837 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1211905a-fd5c-4979-9c5e-88ee40c3cfe9 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.403967 Jul 21 08:34:04.691426 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 275/540] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:04 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:04.802622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-980ce204-a9fc-4178-b53b-1bdee3850df3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:04.811014 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-980ce204-a9fc-4178-b53b-1bdee3850df3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.185273 Jul 21 08:34:04.811623 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 266/541] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:04 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:04.830168 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:04.835146 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:04.842657 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:04.843515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:04.844928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:04.845376 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:04.992155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:05.002241 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:05.004256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:05.005612 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6f7e5f3c-5887-4054-a6fa-1974a32b589f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.179429 Jul 21 08:34:05.007007 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 276/542] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:04 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:05.279284 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-ddaf84c2-495d-44fe-b5ab-74ea2ea1376a req-47d37fdd-f991-4d97-acb6-906105034aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31", "name": "network-vif-plugged", "status": "completed", "tag": "3742ae71-e54f-4d63-9987-96d36f194b44"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:05.292234 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ddaf84c2-495d-44fe-b5ab-74ea2ea1376a req-47d37fdd-f991-4d97-acb6-906105034aa9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:05.292676 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ddaf84c2-495d-44fe-b5ab-74ea2ea1376a req-47d37fdd-f991-4d97-acb6-906105034aa9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:05.306077 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-ddaf84c2-495d-44fe-b5ab-74ea2ea1376a req-47d37fdd-f991-4d97-acb6-906105034aa9 service nova] Creating event network-vif-plugged:3742ae71-e54f-4d63-9987-96d36f194b44 for instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 on hv-cinder-85032 Jul 21 08:34:05.311108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-ddaf84c2-495d-44fe-b5ab-74ea2ea1376a req-47d37fdd-f991-4d97-acb6-906105034aa9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035482 Jul 21 08:34:05.311742 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 267/543] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:34:05.707668 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6cee01e4-81cb-4f19-9794-dada45ceef50 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:05.708327 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6cee01e4-81cb-4f19-9794-dada45ceef50 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:05.719372 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cee01e4-81cb-4f19-9794-dada45ceef50 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:05.719814 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cee01e4-81cb-4f19-9794-dada45ceef50 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:05.720582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cee01e4-81cb-4f19-9794-dada45ceef50 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:05.721051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cee01e4-81cb-4f19-9794-dada45ceef50 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:05.827861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-591e4f5d-3cc9-4083-bae8-0ddb893ed725 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:05.828549 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-591e4f5d-3cc9-4083-bae8-0ddb893ed725 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:05.843276 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-591e4f5d-3cc9-4083-bae8-0ddb893ed725 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:05.853890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-591e4f5d-3cc9-4083-bae8-0ddb893ed725 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:05.855871 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-591e4f5d-3cc9-4083-bae8-0ddb893ed725 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:05.857398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-591e4f5d-3cc9-4083-bae8-0ddb893ed725 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:05.981885 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6cee01e4-81cb-4f19-9794-dada45ceef50 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:05.991830 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6cee01e4-81cb-4f19-9794-dada45ceef50 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.288072 Jul 21 08:34:05.994353 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 277/544] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:05 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:06.029098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:06.030104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:06.059813 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:06.063530 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:06.064654 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:06.065287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:06.162025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-591e4f5d-3cc9-4083-bae8-0ddb893ed725 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:06.171353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-591e4f5d-3cc9-4083-bae8-0ddb893ed725 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.347631 Jul 21 08:34:06.171959 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 268/545] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:05 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:06.280280 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:06.290350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:06.292563 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:06.293940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-905309c2-e67e-47f4-8d50-1b16548e6c3f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.271953 Jul 21 08:34:06.295133 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 278/546] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:06 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:34:07.013231 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b8df067-ba54-4a4e-b58c-3e7035a00c87 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:07.013837 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b8df067-ba54-4a4e-b58c-3e7035a00c87 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:07.017031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:07.021350 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8df067-ba54-4a4e-b58c-3e7035a00c87 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:07.022029 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8df067-ba54-4a4e-b58c-3e7035a00c87 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:07.023559 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8df067-ba54-4a4e-b58c-3e7035a00c87 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:07.024199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b8df067-ba54-4a4e-b58c-3e7035a00c87 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:07.167914 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b8df067-ba54-4a4e-b58c-3e7035a00c87 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:07.179598 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b8df067-ba54-4a4e-b58c-3e7035a00c87 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.169371 Jul 21 08:34:07.180560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 269/547] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:07 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:07.190688 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0bb8eae0-8018-4be3-a93e-ba6293bafc0a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:07.191634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0bb8eae0-8018-4be3-a93e-ba6293bafc0a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:07.199358 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0bb8eae0-8018-4be3-a93e-ba6293bafc0a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:07.199940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0bb8eae0-8018-4be3-a93e-ba6293bafc0a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:07.200802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0bb8eae0-8018-4be3-a93e-ba6293bafc0a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:07.201360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0bb8eae0-8018-4be3-a93e-ba6293bafc0a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:07.317367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:07.318184 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:07.325142 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:07.325702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:07.326503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:07.326999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:07.339253 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0bb8eae0-8018-4be3-a93e-ba6293bafc0a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:07.350887 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0bb8eae0-8018-4be3-a93e-ba6293bafc0a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.166322 Jul 21 08:34:07.351678 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 279/548] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:07 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:07.441149 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:07.458290 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:07.466638 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:07.468174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:07.469319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f85c0ea4-067c-4e62-bc50-2625b8a838fa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.155895 Jul 21 08:34:07.469880 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 270/549] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:07 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:34:08.198320 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7b00695-5fe2-4237-840d-133e2fbce480 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:08.199170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a7b00695-5fe2-4237-840d-133e2fbce480 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:08.206169 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7b00695-5fe2-4237-840d-133e2fbce480 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:08.206621 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7b00695-5fe2-4237-840d-133e2fbce480 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:08.207438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7b00695-5fe2-4237-840d-133e2fbce480 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:08.207921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7b00695-5fe2-4237-840d-133e2fbce480 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:08.359722 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7b00695-5fe2-4237-840d-133e2fbce480 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:08.368906 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60a9d19d-2d8e-4fc5-9226-398a4aa3eb17 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:08.369672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60a9d19d-2d8e-4fc5-9226-398a4aa3eb17 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:08.371826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a7b00695-5fe2-4237-840d-133e2fbce480 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.178293 Jul 21 08:34:08.373061 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 280/550] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:08 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:08.377105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60a9d19d-2d8e-4fc5-9226-398a4aa3eb17 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:08.377554 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60a9d19d-2d8e-4fc5-9226-398a4aa3eb17 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:08.378750 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60a9d19d-2d8e-4fc5-9226-398a4aa3eb17 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:08.379195 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60a9d19d-2d8e-4fc5-9226-398a4aa3eb17 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:08.502441 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:08.503949 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:08.516166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:08.517107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:08.518467 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:08.519365 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:08.612803 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60a9d19d-2d8e-4fc5-9226-398a4aa3eb17 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:08.634615 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60a9d19d-2d8e-4fc5-9226-398a4aa3eb17 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.270215 Jul 21 08:34:08.635209 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 271/551] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:08 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:08.760838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:08.769716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:08.771255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:08.772534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-62aa10c7-00b9-4578-883e-cceef95eb712 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.277865 Jul 21 08:34:08.773094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 281/552] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:08 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:09.388844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-14606297-5201-480b-ab65-366c9517491b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:09.389441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-14606297-5201-480b-ab65-366c9517491b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:09.395603 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14606297-5201-480b-ab65-366c9517491b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:09.396067 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14606297-5201-480b-ab65-366c9517491b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:09.396822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14606297-5201-480b-ab65-366c9517491b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:09.397256 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14606297-5201-480b-ab65-366c9517491b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:09.553017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-14606297-5201-480b-ab65-366c9517491b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:09.563954 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-14606297-5201-480b-ab65-366c9517491b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.178597 Jul 21 08:34:09.573589 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 272/553] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:09 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:09.669487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f01b3781-3722-4534-9504-b2d511e3c0a3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:09.670146 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f01b3781-3722-4534-9504-b2d511e3c0a3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:09.677046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f01b3781-3722-4534-9504-b2d511e3c0a3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:09.677488 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f01b3781-3722-4534-9504-b2d511e3c0a3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:09.678478 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f01b3781-3722-4534-9504-b2d511e3c0a3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:09.678920 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f01b3781-3722-4534-9504-b2d511e3c0a3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:09.700120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:09.790331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:09.791317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:09.797665 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:09.798193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:09.799037 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:09.800129 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:09.861227 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f01b3781-3722-4534-9504-b2d511e3c0a3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:09.869934 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f01b3781-3722-4534-9504-b2d511e3c0a3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.204840 Jul 21 08:34:09.880508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 282/554] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:09 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:09.958358 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:09.967319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:09.968828 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:09.969980 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-988876c6-0577-4a07-a059-71e2716a0000 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.183783 Jul 21 08:34:09.970544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 273/555] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:09 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:10.581487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8403dd31-2d8f-42b5-b930-01c5d57ffb18 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:10.582159 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8403dd31-2d8f-42b5-b930-01c5d57ffb18 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:10.588570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8403dd31-2d8f-42b5-b930-01c5d57ffb18 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:10.589166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8403dd31-2d8f-42b5-b930-01c5d57ffb18 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:10.590034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8403dd31-2d8f-42b5-b930-01c5d57ffb18 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:10.590542 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8403dd31-2d8f-42b5-b930-01c5d57ffb18 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:10.733192 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8403dd31-2d8f-42b5-b930-01c5d57ffb18 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:10.742428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8403dd31-2d8f-42b5-b930-01c5d57ffb18 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.163916 Jul 21 08:34:10.743539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 283/556] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:10 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:10.887789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e8ee8479-7201-4052-962c-a741d7121293 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:10.888385 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e8ee8479-7201-4052-962c-a741d7121293 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:10.894721 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8ee8479-7201-4052-962c-a741d7121293 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:10.895161 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8ee8479-7201-4052-962c-a741d7121293 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:10.895971 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8ee8479-7201-4052-962c-a741d7121293 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:10.896402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8ee8479-7201-4052-962c-a741d7121293 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:10.919165 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:10.988723 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:10.989694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:10.995675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:10.997684 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:10.998500 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:10.999673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:11.000250 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:11.133020 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e8ee8479-7201-4052-962c-a741d7121293 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:11.145095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e8ee8479-7201-4052-962c-a741d7121293 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.261167 Jul 21 08:34:11.181366 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 274/557] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:10 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:11.207567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:11.233958 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-a2132d9c-1179-4d71-881c-2b849d3f5193 req-a0d4c448-062e-489f-9096-756ddf24d8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c09729-8625-497c-b28a-fb99327e229e", "name": "network-vif-plugged", "status": "completed", "tag": "4a25ac86-dd7b-49f3-a64b-cc34f393a6a4"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:11.245136 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-a2132d9c-1179-4d71-881c-2b849d3f5193 req-a0d4c448-062e-489f-9096-756ddf24d8cf service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:11.248366 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-a2132d9c-1179-4d71-881c-2b849d3f5193 req-a0d4c448-062e-489f-9096-756ddf24d8cf service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:11.274554 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:11.277140 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-a2132d9c-1179-4d71-881c-2b849d3f5193 req-a0d4c448-062e-489f-9096-756ddf24d8cf service nova] Creating event network-vif-plugged:4a25ac86-dd7b-49f3-a64b-cc34f393a6a4 for instance 03c09729-8625-497c-b28a-fb99327e229e on hv-cinder-85032 Jul 21 08:34:11.279783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:11.282551 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-a2132d9c-1179-4d71-881c-2b849d3f5193 req-a0d4c448-062e-489f-9096-756ddf24d8cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057150 Jul 21 08:34:11.283247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ab105fc1-91c2-4ecd-bfd6-5c17f203a5ec tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.298795 Jul 21 08:34:11.283719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 275/558] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:34:11.283924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 284/559] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:10 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:11.760353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-24b0db23-cd19-43ae-8559-832c0ea69a5d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:11.761005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-24b0db23-cd19-43ae-8559-832c0ea69a5d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:11.767404 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24b0db23-cd19-43ae-8559-832c0ea69a5d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:11.767844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24b0db23-cd19-43ae-8559-832c0ea69a5d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:11.768607 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24b0db23-cd19-43ae-8559-832c0ea69a5d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:11.769035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24b0db23-cd19-43ae-8559-832c0ea69a5d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:11.937948 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-24b0db23-cd19-43ae-8559-832c0ea69a5d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:11.946862 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-24b0db23-cd19-43ae-8559-832c0ea69a5d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.190865 Jul 21 08:34:11.947467 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 276/560] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:11 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:12.165841 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9211c857-3696-4b06-9e68-9e77d8ad3fe5 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:12.166480 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9211c857-3696-4b06-9e68-9e77d8ad3fe5 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:12.173356 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9211c857-3696-4b06-9e68-9e77d8ad3fe5 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:12.173806 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9211c857-3696-4b06-9e68-9e77d8ad3fe5 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:12.174584 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9211c857-3696-4b06-9e68-9e77d8ad3fe5 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:12.175019 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9211c857-3696-4b06-9e68-9e77d8ad3fe5 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:12.305004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:12.305750 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:12.314656 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:12.315835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:12.316871 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:12.317492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:12.330464 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9211c857-3696-4b06-9e68-9e77d8ad3fe5 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:12.339021 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9211c857-3696-4b06-9e68-9e77d8ad3fe5 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.177173 Jul 21 08:34:12.339833 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 285/561] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:12 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:12.490686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:12.500318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:12.501830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:12.502975 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fefe16bf-131a-48c6-856c-9608e6334989 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.203846 Jul 21 08:34:12.503820 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 277/562] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:12 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:34:12.964523 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-46a10c6a-5b53-4a9e-80bf-f13367e68f3e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:12.965137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-46a10c6a-5b53-4a9e-80bf-f13367e68f3e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:12.971150 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46a10c6a-5b53-4a9e-80bf-f13367e68f3e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:12.971630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46a10c6a-5b53-4a9e-80bf-f13367e68f3e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:12.972397 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46a10c6a-5b53-4a9e-80bf-f13367e68f3e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:12.972839 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46a10c6a-5b53-4a9e-80bf-f13367e68f3e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:13.110323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-46a10c6a-5b53-4a9e-80bf-f13367e68f3e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:13.117738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-46a10c6a-5b53-4a9e-80bf-f13367e68f3e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.157108 Jul 21 08:34:13.118309 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 286/563] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:12 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:13.358449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-573fd14c-cf3a-4879-b404-18c16268f9d7 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:13.359099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-573fd14c-cf3a-4879-b404-18c16268f9d7 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:13.365442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-573fd14c-cf3a-4879-b404-18c16268f9d7 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:13.365887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-573fd14c-cf3a-4879-b404-18c16268f9d7 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:13.366686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-573fd14c-cf3a-4879-b404-18c16268f9d7 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:13.367130 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-573fd14c-cf3a-4879-b404-18c16268f9d7 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:13.518218 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-573fd14c-cf3a-4879-b404-18c16268f9d7 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:13.525374 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:13.526323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:13.528165 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-573fd14c-cf3a-4879-b404-18c16268f9d7 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.173831 Jul 21 08:34:13.533498 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:13.534179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:13.535124 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:13.535734 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:13.540905 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 278/564] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:13 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:13.678991 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:13.687614 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:13.689132 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:13.690297 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1fd74131-af90-4e21-acbe-2868bf95dcd1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.171447 Jul 21 08:34:13.690854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 287/565] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:13 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:34:14.136386 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ac43bbd4-7315-413d-9c1b-e861751b7704 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:14.136987 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ac43bbd4-7315-413d-9c1b-e861751b7704 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:14.143436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac43bbd4-7315-413d-9c1b-e861751b7704 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:14.143876 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac43bbd4-7315-413d-9c1b-e861751b7704 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:14.144662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac43bbd4-7315-413d-9c1b-e861751b7704 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:14.145083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac43bbd4-7315-413d-9c1b-e861751b7704 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:14.283499 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ac43bbd4-7315-413d-9c1b-e861751b7704 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:14.292428 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ac43bbd4-7315-413d-9c1b-e861751b7704 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.160807 Jul 21 08:34:14.293015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 279/566] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:14 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:14.545342 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9990c74-ea35-4fde-8472-d643eeca54b2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:14.545953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e9990c74-ea35-4fde-8472-d643eeca54b2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:14.552459 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9990c74-ea35-4fde-8472-d643eeca54b2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:14.552909 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9990c74-ea35-4fde-8472-d643eeca54b2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:14.553675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9990c74-ea35-4fde-8472-d643eeca54b2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:14.554785 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9990c74-ea35-4fde-8472-d643eeca54b2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:14.700542 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e9990c74-ea35-4fde-8472-d643eeca54b2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:14.712917 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:14.713601 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:14.715927 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e9990c74-ea35-4fde-8472-d643eeca54b2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.174356 Jul 21 08:34:14.716745 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 288/567] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:14 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:14.725347 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:14.725652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:14.727188 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:14.727576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:14.863994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:14.873166 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:14.874783 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:14.876035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9eca66db-ff65-49bd-9bb4-5b24912c8d6e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.170185 Jul 21 08:34:14.881142 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 280/568] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:14 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:34:15.311237 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-832ba3fe-d9b6-4c75-b1b6-5dd6abc35d19 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:15.311896 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-832ba3fe-d9b6-4c75-b1b6-5dd6abc35d19 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:15.318493 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-832ba3fe-d9b6-4c75-b1b6-5dd6abc35d19 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:15.318951 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-832ba3fe-d9b6-4c75-b1b6-5dd6abc35d19 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:15.320261 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-832ba3fe-d9b6-4c75-b1b6-5dd6abc35d19 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:15.320705 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-832ba3fe-d9b6-4c75-b1b6-5dd6abc35d19 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:15.474449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-832ba3fe-d9b6-4c75-b1b6-5dd6abc35d19 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:15.484494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-832ba3fe-d9b6-4c75-b1b6-5dd6abc35d19 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.177017 Jul 21 08:34:15.485078 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 289/569] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:15 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:15.733199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1205397e-733a-4b71-9a7b-cb8676a7c446 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:15.733759 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1205397e-733a-4b71-9a7b-cb8676a7c446 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:15.739878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1205397e-733a-4b71-9a7b-cb8676a7c446 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:15.741225 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1205397e-733a-4b71-9a7b-cb8676a7c446 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:15.743432 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1205397e-733a-4b71-9a7b-cb8676a7c446 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:15.744052 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1205397e-733a-4b71-9a7b-cb8676a7c446 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:15.762917 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-723b1205-e642-45f5-8f60-2e8db7286ad6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:15.763502 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-723b1205-e642-45f5-8f60-2e8db7286ad6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:15.769953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-723b1205-e642-45f5-8f60-2e8db7286ad6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:15.770396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-723b1205-e642-45f5-8f60-2e8db7286ad6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:15.771214 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-723b1205-e642-45f5-8f60-2e8db7286ad6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:15.771687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-723b1205-e642-45f5-8f60-2e8db7286ad6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:15.865194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-723b1205-e642-45f5-8f60-2e8db7286ad6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lazy-loading 'services' on Instance uuid b779892e-87e8-4dd0-b428-4bf2a76ed929 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:34:15.910326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1205397e-733a-4b71-9a7b-cb8676a7c446 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:15.919045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1205397e-733a-4b71-9a7b-cb8676a7c446 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.189574 Jul 21 08:34:15.919672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 281/570] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:15 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:15.924156 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:15.924746 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:15.932985 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:15.933364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:15.934141 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:15.934565 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:15.952329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-723b1205-e642-45f5-8f60-2e8db7286ad6 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929/os-volume_attachments/05c2ca49-acd8-43c8-be26-9f405fab801b" status: 202 len: 0 microversion: 2.1 time: 0.193008 Jul 21 08:34:15.953205 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 290/571] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:34:15 2022] DELETE /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929/os-volume_attachments/05c2ca49-acd8-43c8-be26-9f405fab801b => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:34:16.089264 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:16.098935 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:16.100486 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:16.102196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f02ae7e5-8fb0-4d13-b54a-578fa62f5678 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.181617 Jul 21 08:34:16.102745 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 282/572] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:15 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:16.502507 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a0ebdf22-2f38-4abf-848d-87275cf7511e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:16.503205 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a0ebdf22-2f38-4abf-848d-87275cf7511e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:16.510215 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf22-2f38-4abf-848d-87275cf7511e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:16.510657 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf22-2f38-4abf-848d-87275cf7511e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:16.511430 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf22-2f38-4abf-848d-87275cf7511e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:16.511860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf22-2f38-4abf-848d-87275cf7511e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:16.645768 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a0ebdf22-2f38-4abf-848d-87275cf7511e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:16.653796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a0ebdf22-2f38-4abf-848d-87275cf7511e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.155576 Jul 21 08:34:16.654368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 291/573] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:16 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:16.936404 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c394cc40-0e78-4aaa-914b-b7d0a9ecacce tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:16.936978 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c394cc40-0e78-4aaa-914b-b7d0a9ecacce tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:16.943212 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c394cc40-0e78-4aaa-914b-b7d0a9ecacce tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:16.943690 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c394cc40-0e78-4aaa-914b-b7d0a9ecacce tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:16.945091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c394cc40-0e78-4aaa-914b-b7d0a9ecacce tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:16.945528 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c394cc40-0e78-4aaa-914b-b7d0a9ecacce tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:17.075028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c394cc40-0e78-4aaa-914b-b7d0a9ecacce tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:17.082536 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c394cc40-0e78-4aaa-914b-b7d0a9ecacce tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.150064 Jul 21 08:34:17.083092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 283/574] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:16 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:17.120920 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:17.121596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:17.128093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:17.128805 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:17.129579 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:17.130025 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:17.263917 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:17.276324 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:17.278162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:17.280407 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f3a986d9-ffc2-4ae6-a45f-a7c7f78a77f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.163479 Jul 21 08:34:17.280981 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 292/575] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:17 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:17.670778 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1dcc9638-1a99-4fc6-a0ef-0f6502390fa6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:17.671394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1dcc9638-1a99-4fc6-a0ef-0f6502390fa6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:17.677425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dcc9638-1a99-4fc6-a0ef-0f6502390fa6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:17.677859 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dcc9638-1a99-4fc6-a0ef-0f6502390fa6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:17.678645 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dcc9638-1a99-4fc6-a0ef-0f6502390fa6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:17.679077 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dcc9638-1a99-4fc6-a0ef-0f6502390fa6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:17.812777 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1dcc9638-1a99-4fc6-a0ef-0f6502390fa6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:17.820198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1dcc9638-1a99-4fc6-a0ef-0f6502390fa6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.153252 Jul 21 08:34:17.820774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 284/576] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:17 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:18.099126 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c4cfc2dd-6e2f-482f-a653-7e6a802d8bc2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:18.099825 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c4cfc2dd-6e2f-482f-a653-7e6a802d8bc2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:18.105727 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4cfc2dd-6e2f-482f-a653-7e6a802d8bc2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:18.106173 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4cfc2dd-6e2f-482f-a653-7e6a802d8bc2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:18.106942 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4cfc2dd-6e2f-482f-a653-7e6a802d8bc2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:18.107397 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4cfc2dd-6e2f-482f-a653-7e6a802d8bc2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:18.251278 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c4cfc2dd-6e2f-482f-a653-7e6a802d8bc2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:18.260302 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c4cfc2dd-6e2f-482f-a653-7e6a802d8bc2 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1314 microversion: 2.1 time: 0.164938 Jul 21 08:34:18.261151 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 293/577] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:18 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:18.299297 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:18.299923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:18.307269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:18.307957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:18.309246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:18.310016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:18.449000 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:18.457844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:18.459366 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:18.460521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e10c60c2-58ac-4144-9002-0fadef4eb29b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.165206 Jul 21 08:34:18.461082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 285/578] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:18 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:18.837581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6daa9a3d-2289-43d2-924f-2f3bb181657d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:18.838203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6daa9a3d-2289-43d2-924f-2f3bb181657d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:18.844353 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6daa9a3d-2289-43d2-924f-2f3bb181657d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:18.844808 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6daa9a3d-2289-43d2-924f-2f3bb181657d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:18.845573 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6daa9a3d-2289-43d2-924f-2f3bb181657d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:18.846014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6daa9a3d-2289-43d2-924f-2f3bb181657d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:18.979041 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6daa9a3d-2289-43d2-924f-2f3bb181657d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:18.986546 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6daa9a3d-2289-43d2-924f-2f3bb181657d tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.153411 Jul 21 08:34:18.987128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 294/579] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:18 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:19.277602 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-83b6f462-7483-4934-a7ee-d9f7be8a70f3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:19.278187 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-83b6f462-7483-4934-a7ee-d9f7be8a70f3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:19.284202 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83b6f462-7483-4934-a7ee-d9f7be8a70f3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:19.284635 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83b6f462-7483-4934-a7ee-d9f7be8a70f3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:19.285377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83b6f462-7483-4934-a7ee-d9f7be8a70f3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:19.285796 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83b6f462-7483-4934-a7ee-d9f7be8a70f3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:19.416791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-83b6f462-7483-4934-a7ee-d9f7be8a70f3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:19.424134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-83b6f462-7483-4934-a7ee-d9f7be8a70f3 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1464 microversion: 2.1 time: 0.150326 Jul 21 08:34:19.424686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 286/580] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:19 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:19.463388 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-354844c8-97f8-40a2-b621-f9325d4cc285 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:19.464152 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-354844c8-97f8-40a2-b621-f9325d4cc285 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:19.471058 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-354844c8-97f8-40a2-b621-f9325d4cc285 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:19.471564 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-354844c8-97f8-40a2-b621-f9325d4cc285 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:19.472352 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-354844c8-97f8-40a2-b621-f9325d4cc285 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:19.472795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-354844c8-97f8-40a2-b621-f9325d4cc285 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:19.478342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:19.478940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:19.484938 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:19.485370 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:19.486132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:19.486557 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:19.501093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-354844c8-97f8-40a2-b621-f9325d4cc285 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:34:19.582863 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-354844c8-97f8-40a2-b621-f9325d4cc285 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 204 len: 0 microversion: 2.1 time: 0.123125 Jul 21 08:34:19.586482 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 295/581] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:34:19 2022] DELETE /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:34:19.592047 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c7a116e-7703-4fff-b2f7-ee4e4aaadf8a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:19.593433 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c7a116e-7703-4fff-b2f7-ee4e4aaadf8a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:19.617916 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c7a116e-7703-4fff-b2f7-ee4e4aaadf8a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:19.618371 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c7a116e-7703-4fff-b2f7-ee4e4aaadf8a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:19.619160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c7a116e-7703-4fff-b2f7-ee4e4aaadf8a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:19.619636 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c7a116e-7703-4fff-b2f7-ee4e4aaadf8a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:19.668228 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:19.677259 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:19.678766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:19.680560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de503a2c-dc62-4146-b40e-5761da29cda9 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.206497 Jul 21 08:34:19.681134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 287/582] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:19 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:19.774277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c7a116e-7703-4fff-b2f7-ee4e4aaadf8a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:19.777848 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:19.782921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c7a116e-7703-4fff-b2f7-ee4e4aaadf8a tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1470 microversion: 2.1 time: 0.194963 Jul 21 08:34:19.783521 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 296/583] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:19 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:20.004023 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ae17731-d25d-42ee-b57a-70b60f641933 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:20.004542 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ae17731-d25d-42ee-b57a-70b60f641933 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:20.011081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ae17731-d25d-42ee-b57a-70b60f641933 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:20.011547 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ae17731-d25d-42ee-b57a-70b60f641933 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:20.012300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ae17731-d25d-42ee-b57a-70b60f641933 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:20.012730 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ae17731-d25d-42ee-b57a-70b60f641933 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:20.146454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6ae17731-d25d-42ee-b57a-70b60f641933 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:20.154182 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ae17731-d25d-42ee-b57a-70b60f641933 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.154299 Jul 21 08:34:20.154758 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 288/584] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:19 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:20.699051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:20.699692 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:20.706893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:20.707361 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:20.708127 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:20.708563 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:20.800434 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4c4f9d6a-e4cf-4168-a30c-6cbbfa4a962f tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:20.801043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4c4f9d6a-e4cf-4168-a30c-6cbbfa4a962f tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:20.807044 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d6a-e4cf-4168-a30c-6cbbfa4a962f tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:20.807518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d6a-e4cf-4168-a30c-6cbbfa4a962f tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:20.808282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d6a-e4cf-4168-a30c-6cbbfa4a962f tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:20.808708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d6a-e4cf-4168-a30c-6cbbfa4a962f tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:20.840046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:20.848930 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:20.850501 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:20.852404 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-360db25a-afe5-4fd0-a8db-9d3254bcc179 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.157597 Jul 21 08:34:20.852890 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 297/585] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:20 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:20.941134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4c4f9d6a-e4cf-4168-a30c-6cbbfa4a962f tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:20.949481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4c4f9d6a-e4cf-4168-a30c-6cbbfa4a962f tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1470 microversion: 2.1 time: 0.152752 Jul 21 08:34:20.949980 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 289/586] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:20 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:21.170966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a674bbc-3d3e-4ed5-89b9-90c9f1942847 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:21.171640 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3a674bbc-3d3e-4ed5-89b9-90c9f1942847 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:21.177640 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a674bbc-3d3e-4ed5-89b9-90c9f1942847 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:21.178093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a674bbc-3d3e-4ed5-89b9-90c9f1942847 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:21.178854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a674bbc-3d3e-4ed5-89b9-90c9f1942847 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:21.179291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a674bbc-3d3e-4ed5-89b9-90c9f1942847 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:21.313689 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3a674bbc-3d3e-4ed5-89b9-90c9f1942847 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:21.321567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3a674bbc-3d3e-4ed5-89b9-90c9f1942847 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.154501 Jul 21 08:34:21.322120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 298/587] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:21 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:21.871473 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:21.872130 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:21.879012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:21.879492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:21.880266 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:21.880696 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:21.966146 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d1bf1cde-fef0-40b3-893c-bc30fddd7f84 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:21.967087 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d1bf1cde-fef0-40b3-893c-bc30fddd7f84 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:21.974089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1bf1cde-fef0-40b3-893c-bc30fddd7f84 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:21.974626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1bf1cde-fef0-40b3-893c-bc30fddd7f84 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:21.975514 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1bf1cde-fef0-40b3-893c-bc30fddd7f84 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:21.976981 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1bf1cde-fef0-40b3-893c-bc30fddd7f84 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:22.029552 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:22.037975 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:22.040036 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:22.041189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0860f4d-86e9-42a8-8186-68b5dcaafd95 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.174394 Jul 21 08:34:22.041762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 290/588] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:21 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:22.109899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1bf1cde-fef0-40b3-893c-bc30fddd7f84 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:22.117347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d1bf1cde-fef0-40b3-893c-bc30fddd7f84 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1470 microversion: 2.1 time: 0.155155 Jul 21 08:34:22.117926 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 299/589] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:21 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:22.338989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8195fa2-6c0e-4469-bfb0-1af7503f75a2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:22.339763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8195fa2-6c0e-4469-bfb0-1af7503f75a2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:22.345733 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8195fa2-6c0e-4469-bfb0-1af7503f75a2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:22.346143 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8195fa2-6c0e-4469-bfb0-1af7503f75a2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:22.346889 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8195fa2-6c0e-4469-bfb0-1af7503f75a2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:22.347870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8195fa2-6c0e-4469-bfb0-1af7503f75a2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:22.481128 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8195fa2-6c0e-4469-bfb0-1af7503f75a2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:22.491791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:22.502727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8195fa2-6c0e-4469-bfb0-1af7503f75a2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.168090 Jul 21 08:34:22.503315 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 291/590] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:22 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:22.551873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-70725b13-f5c1-4676-9f6d-e655f9f0a75c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:22.552487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-70725b13-f5c1-4676-9f6d-e655f9f0a75c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:22.558569 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70725b13-f5c1-4676-9f6d-e655f9f0a75c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:22.559025 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70725b13-f5c1-4676-9f6d-e655f9f0a75c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:22.559827 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70725b13-f5c1-4676-9f6d-e655f9f0a75c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:22.560267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70725b13-f5c1-4676-9f6d-e655f9f0a75c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:22.705997 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70725b13-f5c1-4676-9f6d-e655f9f0a75c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:22.718455 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-70725b13-f5c1-4676-9f6d-e655f9f0a75c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1594 microversion: 2.1 time: 0.170260 Jul 21 08:34:22.720582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 300/591] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:22 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1594 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:23.061678 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:23.062447 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:23.070570 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.071018 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.071821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.072252 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.136586 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fa61fdae-f432-4f96-93a4-a4a16b2e03d9 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:23.137203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fa61fdae-f432-4f96-93a4-a4a16b2e03d9 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:23.145933 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa61fdae-f432-4f96-93a4-a4a16b2e03d9 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.146384 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa61fdae-f432-4f96-93a4-a4a16b2e03d9 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.147160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa61fdae-f432-4f96-93a4-a4a16b2e03d9 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.147625 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa61fdae-f432-4f96-93a4-a4a16b2e03d9 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.289681 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fa61fdae-f432-4f96-93a4-a4a16b2e03d9 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:23.297271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fa61fdae-f432-4f96-93a4-a4a16b2e03d9 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1470 microversion: 2.1 time: 0.166277 Jul 21 08:34:23.297849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 301/592] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:23 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:23.380011 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:23.388488 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:23.390287 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:23.391809 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7979c069-573b-4786-bffe-55f33a48d9f4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.335636 Jul 21 08:34:23.392618 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 292/593] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:23 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:23.416630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8af771d5-9d01-4b90-9548-102b16cdbb22 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:23.417173 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8af771d5-9d01-4b90-9548-102b16cdbb22 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:23.423787 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8af771d5-9d01-4b90-9548-102b16cdbb22 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.424240 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8af771d5-9d01-4b90-9548-102b16cdbb22 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.425030 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8af771d5-9d01-4b90-9548-102b16cdbb22 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.425476 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8af771d5-9d01-4b90-9548-102b16cdbb22 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.451832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8af771d5-9d01-4b90-9548-102b16cdbb22 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:34:23.521175 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfa435dd-c559-41d3-9e01-8846f0894842 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:23.522513 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfa435dd-c559-41d3-9e01-8846f0894842 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:23.529470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfa435dd-c559-41d3-9e01-8846f0894842 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.530343 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfa435dd-c559-41d3-9e01-8846f0894842 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.531986 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfa435dd-c559-41d3-9e01-8846f0894842 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.532938 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfa435dd-c559-41d3-9e01-8846f0894842 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.534068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8af771d5-9d01-4b90-9548-102b16cdbb22 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 204 len: 0 microversion: 2.1 time: 0.121222 Jul 21 08:34:23.537898 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 302/594] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:34:23 2022] DELETE /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:34:23.545013 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0e114b4a-49f1-43e3-8291-e2881feb7ecb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:23.545999 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0e114b4a-49f1-43e3-8291-e2881feb7ecb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:23.553523 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e114b4a-49f1-43e3-8291-e2881feb7ecb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.554178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e114b4a-49f1-43e3-8291-e2881feb7ecb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.555681 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e114b4a-49f1-43e3-8291-e2881feb7ecb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.557172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e114b4a-49f1-43e3-8291-e2881feb7ecb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.715803 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0e114b4a-49f1-43e3-8291-e2881feb7ecb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:23.734295 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0e114b4a-49f1-43e3-8291-e2881feb7ecb tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1559 microversion: 2.1 time: 0.193873 Jul 21 08:34:23.739672 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 303/595] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:23 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:23.747350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1f245d57-9a20-42da-9467-fda3aa6c4d5c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cd03fd3-2b63-40bc-a02b-3daa9a0d46ba"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:23.757100 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1f245d57-9a20-42da-9467-fda3aa6c4d5c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:23.777486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f245d57-9a20-42da-9467-fda3aa6c4d5c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.778267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f245d57-9a20-42da-9467-fda3aa6c4d5c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.779200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f245d57-9a20-42da-9467-fda3aa6c4d5c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.779718 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f245d57-9a20-42da-9467-fda3aa6c4d5c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.917263 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfa435dd-c559-41d3-9e01-8846f0894842 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:23.925961 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfa435dd-c559-41d3-9e01-8846f0894842 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1259 microversion: 2.1 time: 0.409376 Jul 21 08:34:23.927247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 293/596] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:23 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1259 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:23.932241 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-68e059b7-00bd-4de8-9ac2-7bcfcf49d374 req-a3bf17b9-fca7-4fe0-a84f-357c1ff759f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31", "name": "network-vif-deleted", "tag": "3742ae71-e54f-4d63-9987-96d36f194b44"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:23.941267 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-68e059b7-00bd-4de8-9ac2-7bcfcf49d374 req-a3bf17b9-fca7-4fe0-a84f-357c1ff759f4 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:23.941720 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-68e059b7-00bd-4de8-9ac2-7bcfcf49d374 req-a3bf17b9-fca7-4fe0-a84f-357c1ff759f4 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:23.955396 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-68e059b7-00bd-4de8-9ac2-7bcfcf49d374 req-a3bf17b9-fca7-4fe0-a84f-357c1ff759f4 service nova] Creating event network-vif-deleted:3742ae71-e54f-4d63-9987-96d36f194b44 for instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 on hv-cinder-85032 Jul 21 08:34:23.961226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-68e059b7-00bd-4de8-9ac2-7bcfcf49d374 req-a3bf17b9-fca7-4fe0-a84f-357c1ff759f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032211 Jul 21 08:34:23.961826 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 294/597] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:34:24.316071 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb297b25-2505-4587-9bd4-3e6d489c4677 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:24.316758 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb297b25-2505-4587-9bd4-3e6d489c4677 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:24.323894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb297b25-2505-4587-9bd4-3e6d489c4677 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:24.324328 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb297b25-2505-4587-9bd4-3e6d489c4677 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:24.325463 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb297b25-2505-4587-9bd4-3e6d489c4677 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:24.325890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb297b25-2505-4587-9bd4-3e6d489c4677 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:24.453038 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fb297b25-2505-4587-9bd4-3e6d489c4677 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:24.460446 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb297b25-2505-4587-9bd4-3e6d489c4677 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1428 microversion: 2.1 time: 0.148868 Jul 21 08:34:24.461015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 295/598] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:24 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:24.469970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:24.469970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:24.472081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:24.472537 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:24.473302 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:24.473730 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:24.784180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:24.793647 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:24.795151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:24.796334 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-620d8078-e453-4646-b7a3-8ab92ed17b41 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.334405 Jul 21 08:34:24.807501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 296/599] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:24 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:24.807501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e995ac2c-407b-4f5d-ac7b-6c1255827427 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:24.807501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e995ac2c-407b-4f5d-ac7b-6c1255827427 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:24.808458 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e995ac2c-407b-4f5d-ac7b-6c1255827427 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:24.808912 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e995ac2c-407b-4f5d-ac7b-6c1255827427 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:24.809687 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e995ac2c-407b-4f5d-ac7b-6c1255827427 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:24.810120 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e995ac2c-407b-4f5d-ac7b-6c1255827427 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.016517 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e995ac2c-407b-4f5d-ac7b-6c1255827427 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:25.024641 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e995ac2c-407b-4f5d-ac7b-6c1255827427 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1513 microversion: 2.1 time: 0.226706 Jul 21 08:34:25.025214 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 297/600] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:24 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:25.029634 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ea64e5cf-be6a-470e-bc6c-527cf4ce1dbe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:25.030229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ea64e5cf-be6a-470e-bc6c-527cf4ce1dbe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:25.036035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea64e5cf-be6a-470e-bc6c-527cf4ce1dbe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.036405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea64e5cf-be6a-470e-bc6c-527cf4ce1dbe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.037148 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea64e5cf-be6a-470e-bc6c-527cf4ce1dbe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.037570 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea64e5cf-be6a-470e-bc6c-527cf4ce1dbe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.238305 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ea64e5cf-be6a-470e-bc6c-527cf4ce1dbe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:25.246383 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ea64e5cf-be6a-470e-bc6c-527cf4ce1dbe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1443 microversion: 2.1 time: 0.220206 Jul 21 08:34:25.246970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 298/601] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:25 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1443 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:25.263751 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5e45659-f24c-48a5-87da-0622b19a69d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:25.264464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5e45659-f24c-48a5-87da-0622b19a69d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:25.270423 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5e45659-f24c-48a5-87da-0622b19a69d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.270857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5e45659-f24c-48a5-87da-0622b19a69d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.271643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5e45659-f24c-48a5-87da-0622b19a69d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.272068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5e45659-f24c-48a5-87da-0622b19a69d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.548368 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5e45659-f24c-48a5-87da-0622b19a69d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:25.557132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5e45659-f24c-48a5-87da-0622b19a69d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1443 microversion: 2.1 time: 0.297698 Jul 21 08:34:25.557716 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 299/602] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:25 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1443 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:25.562598 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:25.563462 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:25.571157 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.571656 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.572693 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.573316 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.616501 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.616928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.617660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lazy-loading 'fault' on Instance uuid 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:34:25.656263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1f245d57-9a20-42da-9467-fda3aa6c4d5c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.915193 Jul 21 08:34:25.656879 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 304/603] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:34:23 2022] POST /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments => generated 194 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:34:25.701135 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:25.710451 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-677486fb-e70a-4ff9-878e-a6587e1b51ec tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1304 microversion: 2.1 time: 0.151323 Jul 21 08:34:25.711467 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 300/604] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:25 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:25.816508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:25.817214 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:25.824590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.825042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.825830 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.826494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:25.985357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-193caa7a-2913-47e5-b203-b4e7c767a48d req-d872757c-aab7-4217-9ef3-f4148ef56994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9611775-7996-4da2-aa8b-5ef9d642cade", "tag": "2d38ba9b-48d8-48b8-bb69-f7ae8db202d3"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:25.996917 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-193caa7a-2913-47e5-b203-b4e7c767a48d req-d872757c-aab7-4217-9ef3-f4148ef56994 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:25.997752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-193caa7a-2913-47e5-b203-b4e7c767a48d req-d872757c-aab7-4217-9ef3-f4148ef56994 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:26.011521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-193caa7a-2913-47e5-b203-b4e7c767a48d req-d872757c-aab7-4217-9ef3-f4148ef56994 service nova] Creating event network-changed:2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 for instance e9611775-7996-4da2-aa8b-5ef9d642cade on hv-cinder-85032 Jul 21 08:34:26.017632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-193caa7a-2913-47e5-b203-b4e7c767a48d req-d872757c-aab7-4217-9ef3-f4148ef56994 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038455 Jul 21 08:34:26.018892 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 301/605] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:34:26.048375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15e39af4-4615-4fe0-a79a-a320b63ab745 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:26.049659 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15e39af4-4615-4fe0-a79a-a320b63ab745 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:26.060545 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15e39af4-4615-4fe0-a79a-a320b63ab745 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:26.061443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15e39af4-4615-4fe0-a79a-a320b63ab745 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:26.063439 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15e39af4-4615-4fe0-a79a-a320b63ab745 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:26.066770 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15e39af4-4615-4fe0-a79a-a320b63ab745 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:26.086984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:26.100242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:26.101780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:26.102971 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-93a4ebce-5c65-4970-97a0-3cacacd2b21b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.291545 Jul 21 08:34:26.113576 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 305/606] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:25 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:26.312757 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-15e39af4-4615-4fe0-a79a-a320b63ab745 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:26.329083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15e39af4-4615-4fe0-a79a-a320b63ab745 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1513 microversion: 2.1 time: 0.289122 Jul 21 08:34:26.329709 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 302/607] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:26 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:26.729637 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:26.733575 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:26.774736 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:26.776246 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:26.779954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:26.788465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:26.930429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:26.931427 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:26.932117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lazy-loading 'fault' on Instance uuid 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:34:27.036728 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6e41c41d76488fb71c1b8a5358b637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b859e8bf4847eea99f02efae52cdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:27.055690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9266c898-6141-4582-806f-84aa2d909628 tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 200 len: 1304 microversion: 2.1 time: 0.331442 Jul 21 08:34:27.056594 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 306/608] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:26 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 1304 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:27.122081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:27.123348 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:27.133206 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:27.134033 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:27.135318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:27.136059 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:27.351188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-aa019c6b-24b1-4161-9c48-25f0f1dc555e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:27.352133 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-aa019c6b-24b1-4161-9c48-25f0f1dc555e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:27.361642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aa019c6b-24b1-4161-9c48-25f0f1dc555e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:27.365655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aa019c6b-24b1-4161-9c48-25f0f1dc555e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:27.367418 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aa019c6b-24b1-4161-9c48-25f0f1dc555e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:27.371899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aa019c6b-24b1-4161-9c48-25f0f1dc555e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:27.452136 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:27.464972 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:27.468791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:27.472380 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93be1a29-7963-4aae-9145-26a01f9ab060 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.354938 Jul 21 08:34:27.486602 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 303/609] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:27 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:27.616327 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-aa019c6b-24b1-4161-9c48-25f0f1dc555e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f914243baf846f5b43a929332bcef6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419b6c6707544364b82f3f6fb5030032', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:27.626340 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-aa019c6b-24b1-4161-9c48-25f0f1dc555e tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 200 len: 1513 microversion: 2.1 time: 0.279037 Jul 21 08:34:27.627506 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 307/610] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:27 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:27.895830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77ada19b-ea77-4ea1-b8be-761afe50c05c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1557292706"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:27.896394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77ada19b-ea77-4ea1-b8be-761afe50c05c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:27.902791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ada19b-ea77-4ea1-b8be-761afe50c05c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:27.903348 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ada19b-ea77-4ea1-b8be-761afe50c05c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:27.904199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ada19b-ea77-4ea1-b8be-761afe50c05c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:27.904703 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ada19b-ea77-4ea1-b8be-761afe50c05c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.033346 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-def2da14-6fdf-417b-8cd3-13d0acc31596 req-fff6862c-4148-4208-b8c9-c67bf813ae1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b779892e-87e8-4dd0-b428-4bf2a76ed929", "name": "network-vif-deleted", "tag": "ee477da8-7dc9-4256-98da-c956095c6475"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:28.043394 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-def2da14-6fdf-417b-8cd3-13d0acc31596 req-fff6862c-4148-4208-b8c9-c67bf813ae1e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.044158 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-def2da14-6fdf-417b-8cd3-13d0acc31596 req-fff6862c-4148-4208-b8c9-c67bf813ae1e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.046147 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.network.security_group_api [None req-77ada19b-ea77-4ea1-b8be-761afe50c05c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Adding security group e6e96a3e-da8d-47b2-82f2-45d26c23a08b to port 2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 Jul 21 08:34:28.056495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-def2da14-6fdf-417b-8cd3-13d0acc31596 req-fff6862c-4148-4208-b8c9-c67bf813ae1e service nova] Creating event network-vif-deleted:ee477da8-7dc9-4256-98da-c956095c6475 for instance b779892e-87e8-4dd0-b428-4bf2a76ed929 on hv-cinder-85032 Jul 21 08:34:28.061538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-def2da14-6fdf-417b-8cd3-13d0acc31596 req-fff6862c-4148-4208-b8c9-c67bf813ae1e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 Jul 21 08:34:28.062357 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 308/611] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:34:28.073970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:28.074812 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] [instance: 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:28.081198 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.081762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.082644 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.083184 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.097335 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] HTTP exception thrown: Instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 could not be found. Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Request method failure captured: Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 HTTP/1.1 Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q9kF3wXOdJhaTRN0BKhwYCtKFJRSiJRzC1oIQYdSUtUsDDAlGcSdqG1cbai5aowlMn47wVDq0H7mM6MqXMPnUQyGR9NTkrw2z1qfksVZU-iN7fOXrtt43YcGwC5hesyW6e1GZ-8HLznfmM4uXb_BcVk_oWQw_hqAGJ9hKWCQ-c83xw Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 05b859e8bf4847eea99f02efae52cdd1 Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesNegativeTest-1852440154 Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:34:28.099263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/05b859e8bf4847eea99f02efae52cdd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_05b859e8bf4847eea99f02efae52cdd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/05b859e8bf4847eea99f02efae52cdd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/05b859e8bf4847eea99f02efae52cdd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesNegativeTest-1852440154 Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 05b859e8bf4847eea99f02efae52cdd1 Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesNegativeTest-1852440154 Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesNegativeTest-1852440154-project Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 1c6e41c41d76488fb71c1b8a5358b637 Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesNegativeTest-1852440154-project Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 could not be found. Jul 21 08:34:28.100811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31'} Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 could not be found. Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:34:28.102287 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 could not be found. Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 could not be found. Jul 21 08:34:28.103774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:28.107788 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] Returning 404 to user: Instance 7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:34:28.108876 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-59ca1c7d-674c-45fe-aaae-1c4651d4c68b tempest-VolumesNegativeTest-1852440154 tempest-VolumesNegativeTest-1852440154-project] 10.222.0.47 "GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31" status: 404 len: 111 microversion: 2.1 time: 0.039526 Jul 21 08:34:28.109931 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 309/612] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:28 2022] GET /compute/v2.1/servers/7271e78f-6cba-44ff-ad2e-4c7dc6a5fc31 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:34:28.441523 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-6d34e745-1035-417b-820c-6fb8901ccab9 req-7fb74aeb-800c-476d-8945-c5311d7c7af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c09729-8625-497c-b28a-fb99327e229e", "tag": "4a25ac86-dd7b-49f3-a64b-cc34f393a6a4"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:28.451684 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-6d34e745-1035-417b-820c-6fb8901ccab9 req-7fb74aeb-800c-476d-8945-c5311d7c7af1 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.452379 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-6d34e745-1035-417b-820c-6fb8901ccab9 req-7fb74aeb-800c-476d-8945-c5311d7c7af1 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.463903 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77ada19b-ea77-4ea1-b8be-761afe50c05c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "POST /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/action" status: 202 len: 0 microversion: 2.1 time: 0.571783 Jul 21 08:34:28.465123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 304/613] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:34:27 2022] POST /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:34:28.473256 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c40b8c7f-eb0f-4172-a671-d07735cb6884 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:28.474948 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c40b8c7f-eb0f-4172-a671-d07735cb6884 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:28.482281 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c40b8c7f-eb0f-4172-a671-d07735cb6884 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.485469 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c40b8c7f-eb0f-4172-a671-d07735cb6884 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.488450 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c40b8c7f-eb0f-4172-a671-d07735cb6884 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.490133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c40b8c7f-eb0f-4172-a671-d07735cb6884 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.492856 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-6d34e745-1035-417b-820c-6fb8901ccab9 req-7fb74aeb-800c-476d-8945-c5311d7c7af1 service nova] Creating event network-changed:4a25ac86-dd7b-49f3-a64b-cc34f393a6a4 for instance 03c09729-8625-497c-b28a-fb99327e229e on hv-cinder-85032 Jul 21 08:34:28.500953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-6d34e745-1035-417b-820c-6fb8901ccab9 req-7fb74aeb-800c-476d-8945-c5311d7c7af1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062964 Jul 21 08:34:28.501796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 310/614] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:34:28.511027 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:28.511771 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:28.529320 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.529830 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.532582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.533252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.881687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:28.897531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:28.901816 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:28.903046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9a6470b5-4869-423a-94bc-57d756f99724 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.399953 Jul 21 08:34:28.918179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 311/615] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:28 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:28.918882 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:28.922110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c40b8c7f-eb0f-4172-a671-d07735cb6884 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:28.937091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c40b8c7f-eb0f-4172-a671-d07735cb6884 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1641 microversion: 2.1 time: 0.467623 Jul 21 08:34:28.938007 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] [instance: b779892e-87e8-4dd0-b428-4bf2a76ed929] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:28.940481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 305/616] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:28 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1641 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:28.949317 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.950726 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.951553 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:28.953569 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:28.965144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:28.997740 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] HTTP exception thrown: Instance b779892e-87e8-4dd0-b428-4bf2a76ed929 could not be found. Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Request method failure captured: Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 HTTP/1.1 Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q7NKaqJdvs7SS5EiTYBs5oNxxYPfnefTJDaS7rkEEPNd-xv8pdXQ2EnaXfMKuiuAzbK3qkl0auiHuxcHgIFfA91xGQwt8OQURPmSJpXTR7qdV_L1lQdp3u2rInhZ8wmlnOC9vs83X07UN0k9dDxuvnHHrQvwu3Z99TlOZ3GK0TX-0s Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 419b6c6707544364b82f3f6fb5030032 Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotTestJSON-654560829 Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:34:29.000642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/419b6c6707544364b82f3f6fb5030032"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_419b6c6707544364b82f3f6fb5030032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/419b6c6707544364b82f3f6fb5030032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/419b6c6707544364b82f3f6fb5030032"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotTestJSON-654560829 Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 419b6c6707544364b82f3f6fb5030032 Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-654560829 Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotTestJSON-654560829-project Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 1f914243baf846f5b43a929332bcef6e Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotTestJSON-654560829-project Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance b779892e-87e8-4dd0-b428-4bf2a76ed929 could not be found. Jul 21 08:34:29.002256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'b779892e-87e8-4dd0-b428-4bf2a76ed929'} Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b779892e-87e8-4dd0-b428-4bf2a76ed929 could not be found. Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:34:29.003101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b779892e-87e8-4dd0-b428-4bf2a76ed929 could not be found. Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b779892e-87e8-4dd0-b428-4bf2a76ed929 could not be found. Jul 21 08:34:29.004639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:34:29.005673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] Returning 404 to user: Instance b779892e-87e8-4dd0-b428-4bf2a76ed929 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:34:29.005673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e9d131a4-091c-4dad-94a2-4301881ef598 tempest-VolumesSnapshotTestJSON-654560829 tempest-VolumesSnapshotTestJSON-654560829-project] 10.222.0.47 "GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929" status: 404 len: 111 microversion: 2.1 time: 0.091855 Jul 21 08:34:29.005673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 312/617] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:28 2022] GET /compute/v2.1/servers/b779892e-87e8-4dd0-b428-4bf2a76ed929 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:34:29.926182 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:29.927317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:29.934353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:29.934808 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:29.936537 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:29.936979 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:30.098096 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-c6f64dcc-7a67-4e28-aa9a-dc58df807a2e req-0aaa3277-fe6f-469e-94d7-5bac40e16e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9611775-7996-4da2-aa8b-5ef9d642cade", "tag": "2d38ba9b-48d8-48b8-bb69-f7ae8db202d3"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:30.117508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-c6f64dcc-7a67-4e28-aa9a-dc58df807a2e req-0aaa3277-fe6f-469e-94d7-5bac40e16e67 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:30.118144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-c6f64dcc-7a67-4e28-aa9a-dc58df807a2e req-0aaa3277-fe6f-469e-94d7-5bac40e16e67 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:30.128036 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:30.132003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-c6f64dcc-7a67-4e28-aa9a-dc58df807a2e req-0aaa3277-fe6f-469e-94d7-5bac40e16e67 service nova] Creating event network-changed:2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 for instance e9611775-7996-4da2-aa8b-5ef9d642cade on hv-cinder-85032 Jul 21 08:34:30.139059 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-c6f64dcc-7a67-4e28-aa9a-dc58df807a2e req-0aaa3277-fe6f-469e-94d7-5bac40e16e67 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055826 Jul 21 08:34:30.140309 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 313/618] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:34:30.142902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:30.145360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:30.146810 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a726e835-10a1-4341-bed0-8c9c05f08586 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.225572 Jul 21 08:34:30.147396 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 306/619] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:29 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:34:31.166064 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:31.166804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:31.173613 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:31.174378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:31.174832 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:31.175653 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:31.321498 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:31.330023 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:31.331571 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:31.332745 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6834efe4-e037-46d5-a2a5-435ec2268029 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.171063 Jul 21 08:34:31.333468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 314/620] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:31 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:32.351770 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:32.352367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:32.358400 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:32.358939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:32.359602 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:32.360030 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:32.500625 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:32.509382 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:32.510887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:32.512055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f59e950c-82b8-4033-ab7f-639b92a3120a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.164689 Jul 21 08:34:32.512619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 307/621] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:32 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:33.529859 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:33.530472 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:33.537060 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:33.537509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:33.538838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:33.539279 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:33.915955 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:33.924564 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:33.926056 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:33.927228 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b2f2ea61-f9bd-42d5-9f7d-46681408bda3 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.401253 Jul 21 08:34:33.927843 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 315/622] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:33 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:34.114560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-3feb4886-f902-4f5d-99ad-a12a1cde6d4d req-3f96b394-0236-4074-9c71-ae2b551424d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a", "name": "network-vif-plugged", "status": "completed", "tag": "dc3ec772-1aa6-40c5-a783-9c70e0e921dd"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:34.123343 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3feb4886-f902-4f5d-99ad-a12a1cde6d4d req-3f96b394-0236-4074-9c71-ae2b551424d0 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:34.123850 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3feb4886-f902-4f5d-99ad-a12a1cde6d4d req-3f96b394-0236-4074-9c71-ae2b551424d0 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:34.136122 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-3feb4886-f902-4f5d-99ad-a12a1cde6d4d req-3f96b394-0236-4074-9c71-ae2b551424d0 service nova] Creating event network-vif-plugged:dc3ec772-1aa6-40c5-a783-9c70e0e921dd for instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a on hv-cinder-85032 Jul 21 08:34:34.141192 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-3feb4886-f902-4f5d-99ad-a12a1cde6d4d req-3f96b394-0236-4074-9c71-ae2b551424d0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030377 Jul 21 08:34:34.141780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 308/623] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:34:34.945816 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:34.947181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:34.972716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:34.975033 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:34.978471 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:34.981372 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:35.228565 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:35.237262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:35.238766 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:35.239972 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8caeb109-7e4b-43b9-8baf-3eb424fb3370 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.298850 Jul 21 08:34:35.240550 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 316/624] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:34 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:34:35.577556 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-07fe2a7f-1e82-417b-9324-ec699d5a0e89 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:35.578611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-07fe2a7f-1e82-417b-9324-ec699d5a0e89 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:35.584792 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07fe2a7f-1e82-417b-9324-ec699d5a0e89 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:35.585963 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07fe2a7f-1e82-417b-9324-ec699d5a0e89 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:35.586733 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07fe2a7f-1e82-417b-9324-ec699d5a0e89 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:35.587167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07fe2a7f-1e82-417b-9324-ec699d5a0e89 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:35.608931 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-07fe2a7f-1e82-417b-9324-ec699d5a0e89 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lazy-loading 'flavor' on Instance uuid 6e1747f3-79a3-4e2d-bda8-49fec0b5018a {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:34:35.720916 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:35.798113 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-07fe2a7f-1e82-417b-9324-ec699d5a0e89 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/action" status: 200 len: 32 microversion: 2.1 time: 0.224825 Jul 21 08:34:35.798997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 309/625] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:34:35 2022] POST /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:34:35.808709 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d18d218a-ebbd-4fdd-991e-a3d3e5e25a7a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:35.809329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d18d218a-ebbd-4fdd-991e-a3d3e5e25a7a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:35.815639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d18d218a-ebbd-4fdd-991e-a3d3e5e25a7a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:35.816085 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d18d218a-ebbd-4fdd-991e-a3d3e5e25a7a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:35.816847 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d18d218a-ebbd-4fdd-991e-a3d3e5e25a7a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:35.817283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d18d218a-ebbd-4fdd-991e-a3d3e5e25a7a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:35.949184 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d18d218a-ebbd-4fdd-991e-a3d3e5e25a7a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:35.957364 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d18d218a-ebbd-4fdd-991e-a3d3e5e25a7a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.152407 Jul 21 08:34:35.957945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 317/626] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:35 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:36.259199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:36.260017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:36.266624 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:36.267066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:36.267852 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:36.268280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:36.468226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:36.479357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:36.480611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:36.481930 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d3b0f555-d183-4418-b703-4ba805b7df7e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.227209 Jul 21 08:34:36.483361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 310/627] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:36 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:36.976085 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7d8f2093-0e11-449a-9bbe-27f5488107c7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:36.977300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7d8f2093-0e11-449a-9bbe-27f5488107c7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:36.986188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d8f2093-0e11-449a-9bbe-27f5488107c7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:36.986645 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d8f2093-0e11-449a-9bbe-27f5488107c7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:36.987538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d8f2093-0e11-449a-9bbe-27f5488107c7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:36.988331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d8f2093-0e11-449a-9bbe-27f5488107c7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:37.130971 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7d8f2093-0e11-449a-9bbe-27f5488107c7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:37.140583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7d8f2093-0e11-449a-9bbe-27f5488107c7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.169069 Jul 21 08:34:37.140583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 318/628] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:36 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:37.505319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:37.505930 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:37.508530 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=85 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:37.514123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:37.514615 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:37.515405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:37.515842 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:37.652955 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:37.661953 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:37.663685 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:37.664945 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0cb89bba-d11a-4acc-bcf4-7213019af40d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1807 microversion: 2.20 time: 0.163799 Jul 21 08:34:37.665579 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 311/629] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:37 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:38.158101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c454e229-d0c1-456e-b55a-12c992062f9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:38.158814 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c454e229-d0c1-456e-b55a-12c992062f9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:38.165657 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c454e229-d0c1-456e-b55a-12c992062f9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:38.166114 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c454e229-d0c1-456e-b55a-12c992062f9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:38.166915 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c454e229-d0c1-456e-b55a-12c992062f9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:38.167378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c454e229-d0c1-456e-b55a-12c992062f9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:38.295049 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c454e229-d0c1-456e-b55a-12c992062f9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:38.303002 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c454e229-d0c1-456e-b55a-12c992062f9c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.149592 Jul 21 08:34:38.303615 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 319/630] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:38 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:38.683007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:38.683629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:38.689663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:38.690105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:38.690857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:38.691362 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:38.825766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:38.834043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:38.836212 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:38.837352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3760598b-1444-46cc-be95-66aeb1d361ef tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1794 microversion: 2.20 time: 0.158252 Jul 21 08:34:38.837919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 312/631] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:34:38 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:34:39.321739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a89399fd-1d15-4c90-b14a-13a7dc12b0a0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:39.322276 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a89399fd-1d15-4c90-b14a-13a7dc12b0a0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:39.328950 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a89399fd-1d15-4c90-b14a-13a7dc12b0a0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:39.329399 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a89399fd-1d15-4c90-b14a-13a7dc12b0a0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:39.330164 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a89399fd-1d15-4c90-b14a-13a7dc12b0a0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:39.330600 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a89399fd-1d15-4c90-b14a-13a7dc12b0a0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:39.462309 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a89399fd-1d15-4c90-b14a-13a7dc12b0a0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:39.470261 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a89399fd-1d15-4c90-b14a-13a7dc12b0a0 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.153008 Jul 21 08:34:39.470835 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 320/632] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:39 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:40.486590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-580be843-ae56-4cc0-bbb6-31e374813bc7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:40.487191 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-580be843-ae56-4cc0-bbb6-31e374813bc7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:40.493799 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-580be843-ae56-4cc0-bbb6-31e374813bc7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:40.494239 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-580be843-ae56-4cc0-bbb6-31e374813bc7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:40.494995 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-580be843-ae56-4cc0-bbb6-31e374813bc7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:40.495464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-580be843-ae56-4cc0-bbb6-31e374813bc7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:40.625048 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-580be843-ae56-4cc0-bbb6-31e374813bc7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:40.633711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-580be843-ae56-4cc0-bbb6-31e374813bc7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.150934 Jul 21 08:34:40.634276 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 313/633] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:40 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:41.652019 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3893da42-8d48-494e-b33d-f58545ca4f26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:41.652626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3893da42-8d48-494e-b33d-f58545ca4f26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:41.654554 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:41.660022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3893da42-8d48-494e-b33d-f58545ca4f26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:41.660470 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3893da42-8d48-494e-b33d-f58545ca4f26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:41.661240 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3893da42-8d48-494e-b33d-f58545ca4f26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:41.661678 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3893da42-8d48-494e-b33d-f58545ca4f26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:41.792935 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3893da42-8d48-494e-b33d-f58545ca4f26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:41.800992 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3893da42-8d48-494e-b33d-f58545ca4f26 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.153952 Jul 21 08:34:41.801577 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 321/634] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:41 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:42.819764 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b408d2ce-709c-4256-adfa-d8ef819b0228 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:42.820383 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b408d2ce-709c-4256-adfa-d8ef819b0228 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:42.826617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b408d2ce-709c-4256-adfa-d8ef819b0228 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:42.827062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b408d2ce-709c-4256-adfa-d8ef819b0228 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:42.827866 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b408d2ce-709c-4256-adfa-d8ef819b0228 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:42.828307 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b408d2ce-709c-4256-adfa-d8ef819b0228 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:42.958104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b408d2ce-709c-4256-adfa-d8ef819b0228 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:42.966074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b408d2ce-709c-4256-adfa-d8ef819b0228 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.151343 Jul 21 08:34:42.966639 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 314/635] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:42 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:43.984098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-acfbb88c-d97e-4c9d-8a8a-5b209c66b50e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:43.984824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-acfbb88c-d97e-4c9d-8a8a-5b209c66b50e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:43.995359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-acfbb88c-d97e-4c9d-8a8a-5b209c66b50e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:43.995359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-acfbb88c-d97e-4c9d-8a8a-5b209c66b50e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:43.995359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-acfbb88c-d97e-4c9d-8a8a-5b209c66b50e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:43.995359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-acfbb88c-d97e-4c9d-8a8a-5b209c66b50e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:44.124928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-acfbb88c-d97e-4c9d-8a8a-5b209c66b50e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:44.133973 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-acfbb88c-d97e-4c9d-8a8a-5b209c66b50e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.153752 Jul 21 08:34:44.134541 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 322/636] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:43 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:45.150863 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f19e964c-7b5a-40f9-90c1-3749b0bd4cba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:45.151491 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f19e964c-7b5a-40f9-90c1-3749b0bd4cba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:45.157456 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f19e964c-7b5a-40f9-90c1-3749b0bd4cba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:45.157891 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f19e964c-7b5a-40f9-90c1-3749b0bd4cba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:45.158632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f19e964c-7b5a-40f9-90c1-3749b0bd4cba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:45.159054 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f19e964c-7b5a-40f9-90c1-3749b0bd4cba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:45.287557 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f19e964c-7b5a-40f9-90c1-3749b0bd4cba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:45.295859 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f19e964c-7b5a-40f9-90c1-3749b0bd4cba tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.148763 Jul 21 08:34:45.296418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 315/637] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:45 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:46.313018 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b24bd370-f0b3-4123-a0aa-9e49a5e2b167 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:46.313552 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b24bd370-f0b3-4123-a0aa-9e49a5e2b167 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:46.320680 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b24bd370-f0b3-4123-a0aa-9e49a5e2b167 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:46.321124 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b24bd370-f0b3-4123-a0aa-9e49a5e2b167 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:46.321880 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b24bd370-f0b3-4123-a0aa-9e49a5e2b167 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:46.322312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b24bd370-f0b3-4123-a0aa-9e49a5e2b167 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:46.454700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b24bd370-f0b3-4123-a0aa-9e49a5e2b167 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:46.462945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b24bd370-f0b3-4123-a0aa-9e49a5e2b167 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.153841 Jul 21 08:34:46.463568 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 323/638] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:46 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:47.480257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f4354f4-3333-4ae2-ab1b-e0f8d1cff9e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:47.480865 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f4354f4-3333-4ae2-ab1b-e0f8d1cff9e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:47.487425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f4354f4-3333-4ae2-ab1b-e0f8d1cff9e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:47.487649 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f4354f4-3333-4ae2-ab1b-e0f8d1cff9e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:47.488412 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f4354f4-3333-4ae2-ab1b-e0f8d1cff9e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:47.488845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f4354f4-3333-4ae2-ab1b-e0f8d1cff9e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:47.617245 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f4354f4-3333-4ae2-ab1b-e0f8d1cff9e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:47.625163 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f4354f4-3333-4ae2-ab1b-e0f8d1cff9e4 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.148803 Jul 21 08:34:47.625738 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 316/639] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:47 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:48.642582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f966d429-fc9f-468c-9493-d1fadf84cd43 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:48.643223 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f966d429-fc9f-468c-9493-d1fadf84cd43 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:48.649756 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f966d429-fc9f-468c-9493-d1fadf84cd43 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:48.650209 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f966d429-fc9f-468c-9493-d1fadf84cd43 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:48.650973 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f966d429-fc9f-468c-9493-d1fadf84cd43 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:48.651449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f966d429-fc9f-468c-9493-d1fadf84cd43 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:48.777167 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f966d429-fc9f-468c-9493-d1fadf84cd43 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:48.785051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f966d429-fc9f-468c-9493-d1fadf84cd43 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.146314 Jul 21 08:34:48.785626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 324/640] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:48 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:49.802189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5612a99c-ae52-4979-a49a-a502f38196f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:49.802748 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5612a99c-ae52-4979-a49a-a502f38196f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:49.812772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5612a99c-ae52-4979-a49a-a502f38196f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:49.813208 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5612a99c-ae52-4979-a49a-a502f38196f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:49.814016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5612a99c-ae52-4979-a49a-a502f38196f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:49.821692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5612a99c-ae52-4979-a49a-a502f38196f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:49.956718 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5612a99c-ae52-4979-a49a-a502f38196f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:49.965260 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5612a99c-ae52-4979-a49a-a502f38196f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.167139 Jul 21 08:34:49.965829 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 317/641] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:49 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:50.982154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-38030b35-8f88-404d-bd03-957c36628033 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:50.982801 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-38030b35-8f88-404d-bd03-957c36628033 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:50.989380 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38030b35-8f88-404d-bd03-957c36628033 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:50.989836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38030b35-8f88-404d-bd03-957c36628033 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:50.991294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38030b35-8f88-404d-bd03-957c36628033 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:50.991767 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38030b35-8f88-404d-bd03-957c36628033 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:51.125492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-38030b35-8f88-404d-bd03-957c36628033 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:51.133827 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-38030b35-8f88-404d-bd03-957c36628033 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.155539 Jul 21 08:34:51.134403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 325/642] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:50 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:52.149959 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6fb331e2-57e9-498e-9966-ce07e730a55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:52.150556 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6fb331e2-57e9-498e-9966-ce07e730a55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:52.156537 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6fb331e2-57e9-498e-9966-ce07e730a55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:52.156971 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6fb331e2-57e9-498e-9966-ce07e730a55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:52.157711 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6fb331e2-57e9-498e-9966-ce07e730a55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:52.158134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6fb331e2-57e9-498e-9966-ce07e730a55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:52.287904 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6fb331e2-57e9-498e-9966-ce07e730a55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:52.295724 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6fb331e2-57e9-498e-9966-ce07e730a55a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.149592 Jul 21 08:34:52.296292 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 318/643] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:52 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:53.313379 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0b8b906b-0d4b-4565-93dd-6b3899b803a8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:53.314524 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0b8b906b-0d4b-4565-93dd-6b3899b803a8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:53.321350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b8b906b-0d4b-4565-93dd-6b3899b803a8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:53.321803 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b8b906b-0d4b-4565-93dd-6b3899b803a8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:53.322579 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b8b906b-0d4b-4565-93dd-6b3899b803a8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:53.323022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b8b906b-0d4b-4565-93dd-6b3899b803a8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:53.513890 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0b8b906b-0d4b-4565-93dd-6b3899b803a8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:53.522778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0b8b906b-0d4b-4565-93dd-6b3899b803a8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.212609 Jul 21 08:34:53.523401 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 326/644] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:53 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:54.540646 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-defd43ba-4ffd-4c38-968c-80506329edf2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:54.541284 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-defd43ba-4ffd-4c38-968c-80506329edf2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:54.547262 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-defd43ba-4ffd-4c38-968c-80506329edf2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:54.547737 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-defd43ba-4ffd-4c38-968c-80506329edf2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:54.548524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-defd43ba-4ffd-4c38-968c-80506329edf2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:54.548956 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-defd43ba-4ffd-4c38-968c-80506329edf2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:54.698960 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-defd43ba-4ffd-4c38-968c-80506329edf2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:54.706848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-defd43ba-4ffd-4c38-968c-80506329edf2 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1735 microversion: 2.1 time: 0.170665 Jul 21 08:34:54.707426 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 319/645] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:54 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:55.725286 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-525ea2a6-a5b1-4269-a00e-63bdd0b260fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:55.725750 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-525ea2a6-a5b1-4269-a00e-63bdd0b260fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:55.732631 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-525ea2a6-a5b1-4269-a00e-63bdd0b260fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:55.733168 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-525ea2a6-a5b1-4269-a00e-63bdd0b260fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:55.734076 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-525ea2a6-a5b1-4269-a00e-63bdd0b260fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:55.734583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-525ea2a6-a5b1-4269-a00e-63bdd0b260fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:55.885729 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-525ea2a6-a5b1-4269-a00e-63bdd0b260fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:55.894583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-525ea2a6-a5b1-4269-a00e-63bdd0b260fa tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1715 microversion: 2.1 time: 0.173835 Jul 21 08:34:55.895154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 327/646] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:55 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:55.998507 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:55.999029 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:56.005270 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:56.005714 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:56.006472 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:56.006904 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:56.128814 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] HTTP exception thrown: Cannot 'detach_volume' instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a while it is in vm_state rescued Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Request method failure captured: Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments/2cd03fd3-2b63-40bc-a02b-3daa9a0d46ba HTTP/1.1 Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6iM3ePdQNOYU9NrpZdSW4k5-tepkW1LXnF6xRNHWXzWwVe2K6dnDtR3dekzKN6kda1f2LJgjvXP36sczxR0S88U2jjKCXvgq3JucN9neKfptczv3FD2wZGwDlmv9_n-KoklrOHHAuEWSWzSa1xT8JTkbN_FOiRQDDENLNKjXqTGOg Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:34:56.130391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 3528104f3e914d62a10e80e13d3c97de Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:34:56.132015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Cannot 'detach_volume' instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a while it is in vm_state rescued Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '6e1747f3-79a3-4e2d-bda8-49fec0b5018a', 'id': '2cd03fd3-2b63-40bc-a02b-3daa9a0d46ba'} Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:34:56.132894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a while it is in vm_state rescued Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a while it is in vm_state rescued Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:34:56.134494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Returning 409 to user: Cannot 'detach_volume' instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a while it is in vm_state rescued {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:34:56.135889 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6e10668a-5606-43cc-9d3b-f5f37c43f418 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments/2cd03fd3-2b63-40bc-a02b-3daa9a0d46ba" status: 409 len: 152 microversion: 2.1 time: 0.137304 Jul 21 08:34:56.135889 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 320/647] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:34:55 2022] DELETE /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments/2cd03fd3-2b63-40bc-a02b-3daa9a0d46ba => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 08:34:56.140580 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a6af714e-3564-4c83-93bc-4b207a331cb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:56.141114 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a6af714e-3564-4c83-93bc-4b207a331cb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:56.147528 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6af714e-3564-4c83-93bc-4b207a331cb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:56.147979 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6af714e-3564-4c83-93bc-4b207a331cb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:56.148735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6af714e-3564-4c83-93bc-4b207a331cb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:56.149170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6af714e-3564-4c83-93bc-4b207a331cb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:56.216081 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a6af714e-3564-4c83-93bc-4b207a331cb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "POST /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/action" status: 202 len: 0 microversion: 2.1 time: 0.078915 Jul 21 08:34:56.216757 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 328/648] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:34:56 2022] POST /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:34:56.224988 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-69ca63e5-a429-45ea-8fc5-d0a836dccb7c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:56.225613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-69ca63e5-a429-45ea-8fc5-d0a836dccb7c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:56.232913 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69ca63e5-a429-45ea-8fc5-d0a836dccb7c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:56.233398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69ca63e5-a429-45ea-8fc5-d0a836dccb7c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:56.234243 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69ca63e5-a429-45ea-8fc5-d0a836dccb7c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:56.234768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69ca63e5-a429-45ea-8fc5-d0a836dccb7c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:56.361454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69ca63e5-a429-45ea-8fc5-d0a836dccb7c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:56.369375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-69ca63e5-a429-45ea-8fc5-d0a836dccb7c tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.148172 Jul 21 08:34:56.369934 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 321/649] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:56 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:34:57.387784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6aa3ab55-e9cf-4939-bed2-c6d5d24c5373 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:57.388393 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6aa3ab55-e9cf-4939-bed2-c6d5d24c5373 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:57.394656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6aa3ab55-e9cf-4939-bed2-c6d5d24c5373 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:57.395097 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6aa3ab55-e9cf-4939-bed2-c6d5d24c5373 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:57.395899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6aa3ab55-e9cf-4939-bed2-c6d5d24c5373 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:57.396337 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6aa3ab55-e9cf-4939-bed2-c6d5d24c5373 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:57.401219 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:57.532966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6aa3ab55-e9cf-4939-bed2-c6d5d24c5373 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:57.541693 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6aa3ab55-e9cf-4939-bed2-c6d5d24c5373 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.158902 Jul 21 08:34:57.542354 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 329/650] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:57 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:58.055461 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66bdfbad-abcc-4d22-88ff-64762fc2d596 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:34:58.056470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66bdfbad-abcc-4d22-88ff-64762fc2d596 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:58.062550 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66bdfbad-abcc-4d22-88ff-64762fc2d596 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:58.062993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66bdfbad-abcc-4d22-88ff-64762fc2d596 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:58.063809 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66bdfbad-abcc-4d22-88ff-64762fc2d596 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:58.064244 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66bdfbad-abcc-4d22-88ff-64762fc2d596 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:58.135814 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66bdfbad-abcc-4d22-88ff-64762fc2d596 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "POST /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/action" status: 202 len: 0 microversion: 2.1 time: 0.084184 Jul 21 08:34:58.136645 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 322/651] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:34:58 2022] POST /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:34:58.144494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-87ddad27-8782-4ac7-9955-595cb58dd54d tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:58.145109 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-87ddad27-8782-4ac7-9955-595cb58dd54d tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:58.151169 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87ddad27-8782-4ac7-9955-595cb58dd54d tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:58.151657 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87ddad27-8782-4ac7-9955-595cb58dd54d tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:58.152427 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87ddad27-8782-4ac7-9955-595cb58dd54d tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:58.152862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87ddad27-8782-4ac7-9955-595cb58dd54d tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:58.297014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-87ddad27-8782-4ac7-9955-595cb58dd54d tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:58.305539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-87ddad27-8782-4ac7-9955-595cb58dd54d tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1751 microversion: 2.1 time: 0.164908 Jul 21 08:34:58.306112 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 330/652] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:58 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:58.560127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0776033c-ad22-4b0f-9b17-bef2876b0232 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:58.560823 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0776033c-ad22-4b0f-9b17-bef2876b0232 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:58.567011 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0776033c-ad22-4b0f-9b17-bef2876b0232 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:58.567493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0776033c-ad22-4b0f-9b17-bef2876b0232 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:58.568304 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0776033c-ad22-4b0f-9b17-bef2876b0232 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:58.569046 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0776033c-ad22-4b0f-9b17-bef2876b0232 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:58.707438 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0776033c-ad22-4b0f-9b17-bef2876b0232 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:58.716788 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0776033c-ad22-4b0f-9b17-bef2876b0232 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.160864 Jul 21 08:34:58.727658 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 323/653] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:58 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:59.322502 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4e311c92-818d-4a68-ac1f-2fcd259de494 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:59.323114 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4e311c92-818d-4a68-ac1f-2fcd259de494 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:59.329667 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e311c92-818d-4a68-ac1f-2fcd259de494 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:59.330122 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e311c92-818d-4a68-ac1f-2fcd259de494 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:59.330898 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e311c92-818d-4a68-ac1f-2fcd259de494 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:59.331360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e311c92-818d-4a68-ac1f-2fcd259de494 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:59.474408 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4e311c92-818d-4a68-ac1f-2fcd259de494 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:59.482436 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4e311c92-818d-4a68-ac1f-2fcd259de494 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1751 microversion: 2.1 time: 0.164330 Jul 21 08:34:59.483006 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 331/654] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:59 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:34:59.735031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e810619-0119-4e50-95e8-d417a7aa4444 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:34:59.735673 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e810619-0119-4e50-95e8-d417a7aa4444 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:34:59.742195 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e810619-0119-4e50-95e8-d417a7aa4444 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:59.742638 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e810619-0119-4e50-95e8-d417a7aa4444 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:59.743546 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e810619-0119-4e50-95e8-d417a7aa4444 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:34:59.743984 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e810619-0119-4e50-95e8-d417a7aa4444 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:34:59.747916 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:34:59.872005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e810619-0119-4e50-95e8-d417a7aa4444 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:34:59.881629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e810619-0119-4e50-95e8-d417a7aa4444 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.149078 Jul 21 08:34:59.881629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 324/655] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:34:59 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:00.499537 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-39d8a4f3-e3cc-4ffb-8dcb-129e8091a717 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:00.500190 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-39d8a4f3-e3cc-4ffb-8dcb-129e8091a717 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:00.507546 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39d8a4f3-e3cc-4ffb-8dcb-129e8091a717 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:00.508000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39d8a4f3-e3cc-4ffb-8dcb-129e8091a717 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:00.508768 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39d8a4f3-e3cc-4ffb-8dcb-129e8091a717 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:00.509208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39d8a4f3-e3cc-4ffb-8dcb-129e8091a717 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:00.663669 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-39d8a4f3-e3cc-4ffb-8dcb-129e8091a717 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:00.671795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-39d8a4f3-e3cc-4ffb-8dcb-129e8091a717 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1751 microversion: 2.1 time: 0.176097 Jul 21 08:35:00.672367 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 332/656] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:00 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:00.897477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d120fa80-b2c8-4ebf-b9df-00b62f978a6e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:00.898093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d120fa80-b2c8-4ebf-b9df-00b62f978a6e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:00.904123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d120fa80-b2c8-4ebf-b9df-00b62f978a6e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:00.904566 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d120fa80-b2c8-4ebf-b9df-00b62f978a6e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:00.905325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d120fa80-b2c8-4ebf-b9df-00b62f978a6e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:00.905753 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d120fa80-b2c8-4ebf-b9df-00b62f978a6e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:01.035108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d120fa80-b2c8-4ebf-b9df-00b62f978a6e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:01.043481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d120fa80-b2c8-4ebf-b9df-00b62f978a6e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.149845 Jul 21 08:35:01.044043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 325/657] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:00 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:01.688460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-93e08f92-252b-4787-a0e3-24d4c4c888b3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:01.689084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-93e08f92-252b-4787-a0e3-24d4c4c888b3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:01.696133 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93e08f92-252b-4787-a0e3-24d4c4c888b3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:01.696586 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93e08f92-252b-4787-a0e3-24d4c4c888b3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:01.697376 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93e08f92-252b-4787-a0e3-24d4c4c888b3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:01.697819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93e08f92-252b-4787-a0e3-24d4c4c888b3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:01.849225 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-93e08f92-252b-4787-a0e3-24d4c4c888b3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:01.858166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-93e08f92-252b-4787-a0e3-24d4c4c888b3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1751 microversion: 2.1 time: 0.173563 Jul 21 08:35:01.858734 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 333/658] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:01 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:02.061072 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ec476d0a-e392-46c0-8443-b2abe87c73ec tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:02.061610 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ec476d0a-e392-46c0-8443-b2abe87c73ec tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:02.067663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec476d0a-e392-46c0-8443-b2abe87c73ec tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:02.068110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec476d0a-e392-46c0-8443-b2abe87c73ec tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:02.068869 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec476d0a-e392-46c0-8443-b2abe87c73ec tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:02.069301 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec476d0a-e392-46c0-8443-b2abe87c73ec tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:02.196553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ec476d0a-e392-46c0-8443-b2abe87c73ec tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:02.204574 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ec476d0a-e392-46c0-8443-b2abe87c73ec tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.147448 Jul 21 08:35:02.205152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 326/659] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:02 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:02.875795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-92506420-7f70-4c21-bd96-6a223f8812a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:02.876350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-92506420-7f70-4c21-bd96-6a223f8812a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:02.883928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92506420-7f70-4c21-bd96-6a223f8812a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:02.884381 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92506420-7f70-4c21-bd96-6a223f8812a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:02.885157 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92506420-7f70-4c21-bd96-6a223f8812a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:02.885593 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92506420-7f70-4c21-bd96-6a223f8812a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:03.029125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-92506420-7f70-4c21-bd96-6a223f8812a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:03.037597 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-92506420-7f70-4c21-bd96-6a223f8812a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.165279 Jul 21 08:35:03.038168 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 334/660] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:02 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:03.221989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48840e23-d117-4c3f-bc40-0715429a55b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:03.222603 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48840e23-d117-4c3f-bc40-0715429a55b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:03.229114 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48840e23-d117-4c3f-bc40-0715429a55b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:03.229553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48840e23-d117-4c3f-bc40-0715429a55b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:03.230309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48840e23-d117-4c3f-bc40-0715429a55b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:03.230739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48840e23-d117-4c3f-bc40-0715429a55b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:03.365792 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48840e23-d117-4c3f-bc40-0715429a55b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:03.374180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48840e23-d117-4c3f-bc40-0715429a55b6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.155564 Jul 21 08:35:03.375044 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 327/661] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:03 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:04.053966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4ef689fb-e2df-448c-aac2-b34980bfe1ff tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:04.054660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4ef689fb-e2df-448c-aac2-b34980bfe1ff tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:04.061334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ef689fb-e2df-448c-aac2-b34980bfe1ff tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:04.061590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ef689fb-e2df-448c-aac2-b34980bfe1ff tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:04.062347 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ef689fb-e2df-448c-aac2-b34980bfe1ff tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:04.062783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ef689fb-e2df-448c-aac2-b34980bfe1ff tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:04.202068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4ef689fb-e2df-448c-aac2-b34980bfe1ff tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:04.210055 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4ef689fb-e2df-448c-aac2-b34980bfe1ff tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.159970 Jul 21 08:35:04.210630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 335/662] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:04 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:04.392790 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-137178fa-46f5-4cbb-81d1-e2f01c4958d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:04.393431 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-137178fa-46f5-4cbb-81d1-e2f01c4958d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:04.399508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-137178fa-46f5-4cbb-81d1-e2f01c4958d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:04.399950 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-137178fa-46f5-4cbb-81d1-e2f01c4958d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:04.400703 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-137178fa-46f5-4cbb-81d1-e2f01c4958d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:04.401132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-137178fa-46f5-4cbb-81d1-e2f01c4958d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:04.533277 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-137178fa-46f5-4cbb-81d1-e2f01c4958d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:04.543012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-137178fa-46f5-4cbb-81d1-e2f01c4958d7 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.153932 Jul 21 08:35:04.543543 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 328/663] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:04 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:05.227413 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f62d023f-a989-4e08-91a0-2dbbd5f1e652 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:05.228041 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f62d023f-a989-4e08-91a0-2dbbd5f1e652 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:05.235904 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f62d023f-a989-4e08-91a0-2dbbd5f1e652 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:05.236345 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f62d023f-a989-4e08-91a0-2dbbd5f1e652 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:05.237125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f62d023f-a989-4e08-91a0-2dbbd5f1e652 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:05.237564 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f62d023f-a989-4e08-91a0-2dbbd5f1e652 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:05.383315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f62d023f-a989-4e08-91a0-2dbbd5f1e652 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:05.392673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f62d023f-a989-4e08-91a0-2dbbd5f1e652 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.169657 Jul 21 08:35:05.393290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 336/664] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:05 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:05.573063 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1f5c588-05d4-412a-b607-8eb3420bb6fc tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:05.573653 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1f5c588-05d4-412a-b607-8eb3420bb6fc tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:05.579695 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1f5c588-05d4-412a-b607-8eb3420bb6fc tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:05.580134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1f5c588-05d4-412a-b607-8eb3420bb6fc tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:05.580884 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1f5c588-05d4-412a-b607-8eb3420bb6fc tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:05.581315 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1f5c588-05d4-412a-b607-8eb3420bb6fc tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:05.708051 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f1f5c588-05d4-412a-b607-8eb3420bb6fc tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:05.716482 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1f5c588-05d4-412a-b607-8eb3420bb6fc tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.147210 Jul 21 08:35:05.717044 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 329/665] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:05 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:06.409776 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0723410d-8370-4157-98ce-672e654b42d7 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:06.410393 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0723410d-8370-4157-98ce-672e654b42d7 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:06.417468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0723410d-8370-4157-98ce-672e654b42d7 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:06.417910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0723410d-8370-4157-98ce-672e654b42d7 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:06.418655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0723410d-8370-4157-98ce-672e654b42d7 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:06.419084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0723410d-8370-4157-98ce-672e654b42d7 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:06.563128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0723410d-8370-4157-98ce-672e654b42d7 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:06.577451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0723410d-8370-4157-98ce-672e654b42d7 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.171054 Jul 21 08:35:06.578484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 337/666] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:06 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:06.737944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-781cb3d4-92f1-49a0-bc8c-3e648f71cfd8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:06.738589 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-781cb3d4-92f1-49a0-bc8c-3e648f71cfd8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:06.744441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-781cb3d4-92f1-49a0-bc8c-3e648f71cfd8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:06.744886 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-781cb3d4-92f1-49a0-bc8c-3e648f71cfd8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:06.745639 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-781cb3d4-92f1-49a0-bc8c-3e648f71cfd8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:06.746066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-781cb3d4-92f1-49a0-bc8c-3e648f71cfd8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:06.876719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-781cb3d4-92f1-49a0-bc8c-3e648f71cfd8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:06.887046 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-781cb3d4-92f1-49a0-bc8c-3e648f71cfd8 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1723 microversion: 2.1 time: 0.153198 Jul 21 08:35:06.887749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 330/667] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:06 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:07.594159 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9a91a459-c698-4772-8607-7cd4b3e87f69 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:07.594780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9a91a459-c698-4772-8607-7cd4b3e87f69 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:07.601866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a91a459-c698-4772-8607-7cd4b3e87f69 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:07.602342 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a91a459-c698-4772-8607-7cd4b3e87f69 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:07.603085 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a91a459-c698-4772-8607-7cd4b3e87f69 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:07.603555 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a91a459-c698-4772-8607-7cd4b3e87f69 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:07.751029 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9a91a459-c698-4772-8607-7cd4b3e87f69 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:07.759236 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9a91a459-c698-4772-8607-7cd4b3e87f69 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.168859 Jul 21 08:35:07.759841 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 338/668] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:07 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:07.903534 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae1978f6-96ab-48da-83fc-884fcc9271d5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:07.904141 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae1978f6-96ab-48da-83fc-884fcc9271d5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:07.906002 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=40 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:07.911779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae1978f6-96ab-48da-83fc-884fcc9271d5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:07.912839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae1978f6-96ab-48da-83fc-884fcc9271d5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:07.913611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae1978f6-96ab-48da-83fc-884fcc9271d5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:07.914045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae1978f6-96ab-48da-83fc-884fcc9271d5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:08.053019 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae1978f6-96ab-48da-83fc-884fcc9271d5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:08.061414 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae1978f6-96ab-48da-83fc-884fcc9271d5 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1729 microversion: 2.1 time: 0.161740 Jul 21 08:35:08.061985 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 331/669] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:07 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:35:08.078470 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-16d8d882-dc08-4129-9a39-4ec3cdb53abb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:08.078988 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-16d8d882-dc08-4129-9a39-4ec3cdb53abb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:08.085883 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16d8d882-dc08-4129-9a39-4ec3cdb53abb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:08.086337 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16d8d882-dc08-4129-9a39-4ec3cdb53abb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:08.087101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16d8d882-dc08-4129-9a39-4ec3cdb53abb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:08.087588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16d8d882-dc08-4129-9a39-4ec3cdb53abb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:08.167020 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-16d8d882-dc08-4129-9a39-4ec3cdb53abb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092858 Jul 21 08:35:08.167650 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 339/670] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 21 08:35:08 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:35:08.775782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2aca28c-8b6a-4392-8d62-76698e7a1ed0 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:08.776394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2aca28c-8b6a-4392-8d62-76698e7a1ed0 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:08.782508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2aca28c-8b6a-4392-8d62-76698e7a1ed0 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:08.783596 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2aca28c-8b6a-4392-8d62-76698e7a1ed0 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:08.784372 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2aca28c-8b6a-4392-8d62-76698e7a1ed0 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:08.784805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2aca28c-8b6a-4392-8d62-76698e7a1ed0 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:09.023771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2aca28c-8b6a-4392-8d62-76698e7a1ed0 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:09.031724 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2aca28c-8b6a-4392-8d62-76698e7a1ed0 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.259969 Jul 21 08:35:09.032298 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 332/671] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:08 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:09.205421 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-7b4de1df-1140-495c-b2dd-0ea4e453d97d req-2e6096dc-cd32-420d-a397-0629599477ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1747f3-79a3-4e2d-bda8-49fec0b5018a", "tag": "ef56d972-ef7d-4c22-ae07-b6fd0167acb2"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:09.214828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-7b4de1df-1140-495c-b2dd-0ea4e453d97d req-2e6096dc-cd32-420d-a397-0629599477ed service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:09.215512 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-7b4de1df-1140-495c-b2dd-0ea4e453d97d req-2e6096dc-cd32-420d-a397-0629599477ed service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:09.227434 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-7b4de1df-1140-495c-b2dd-0ea4e453d97d req-2e6096dc-cd32-420d-a397-0629599477ed service nova] Creating event network-changed:ef56d972-ef7d-4c22-ae07-b6fd0167acb2 for instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a on hv-cinder-85032 Jul 21 08:35:09.232633 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-7b4de1df-1140-495c-b2dd-0ea4e453d97d req-2e6096dc-cd32-420d-a397-0629599477ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031316 Jul 21 08:35:09.233331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 340/672] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:35:10.049319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-115223e4-fbb1-4a4d-9bd1-14ae703a5ddc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:10.049918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-115223e4-fbb1-4a4d-9bd1-14ae703a5ddc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:10.056159 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-115223e4-fbb1-4a4d-9bd1-14ae703a5ddc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:10.056592 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-115223e4-fbb1-4a4d-9bd1-14ae703a5ddc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:10.057336 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-115223e4-fbb1-4a4d-9bd1-14ae703a5ddc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:10.057755 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-115223e4-fbb1-4a4d-9bd1-14ae703a5ddc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:10.200633 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-115223e4-fbb1-4a4d-9bd1-14ae703a5ddc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:10.208575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-115223e4-fbb1-4a4d-9bd1-14ae703a5ddc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.163105 Jul 21 08:35:10.209142 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 333/673] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:10 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:11.226878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-874f1aae-5f82-483d-af3b-b3e616eb69b4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:11.227719 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-874f1aae-5f82-483d-af3b-b3e616eb69b4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:11.233890 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-874f1aae-5f82-483d-af3b-b3e616eb69b4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:11.234331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-874f1aae-5f82-483d-af3b-b3e616eb69b4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:11.235094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-874f1aae-5f82-483d-af3b-b3e616eb69b4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:11.235552 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-874f1aae-5f82-483d-af3b-b3e616eb69b4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:11.246420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-9f57b1a0-8733-4efd-a504-1988ef868358 req-058700e7-de65-4f92-89fc-e370b4ae4816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1747f3-79a3-4e2d-bda8-49fec0b5018a", "tag": "ef56d972-ef7d-4c22-ae07-b6fd0167acb2"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:11.254698 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-9f57b1a0-8733-4efd-a504-1988ef868358 req-058700e7-de65-4f92-89fc-e370b4ae4816 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:11.255134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-9f57b1a0-8733-4efd-a504-1988ef868358 req-058700e7-de65-4f92-89fc-e370b4ae4816 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:11.267443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-9f57b1a0-8733-4efd-a504-1988ef868358 req-058700e7-de65-4f92-89fc-e370b4ae4816 service nova] Creating event network-changed:ef56d972-ef7d-4c22-ae07-b6fd0167acb2 for instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a on hv-cinder-85032 Jul 21 08:35:11.273066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-9f57b1a0-8733-4efd-a504-1988ef868358 req-058700e7-de65-4f92-89fc-e370b4ae4816 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030244 Jul 21 08:35:11.273838 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 334/674] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:35:11.464313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-874f1aae-5f82-483d-af3b-b3e616eb69b4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:11.472496 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-874f1aae-5f82-483d-af3b-b3e616eb69b4 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.250204 Jul 21 08:35:11.472989 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 341/675] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:11 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:12.490305 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-88f49780-ef12-405d-b2be-d748f2de4fe8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:12.491011 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-88f49780-ef12-405d-b2be-d748f2de4fe8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:12.497320 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88f49780-ef12-405d-b2be-d748f2de4fe8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:12.497762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88f49780-ef12-405d-b2be-d748f2de4fe8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:12.498519 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88f49780-ef12-405d-b2be-d748f2de4fe8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:12.498950 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88f49780-ef12-405d-b2be-d748f2de4fe8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:12.811481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-88f49780-ef12-405d-b2be-d748f2de4fe8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:12.820150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-88f49780-ef12-405d-b2be-d748f2de4fe8 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.334145 Jul 21 08:35:12.820707 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 335/676] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:12 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:13.837858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1126691e-9e8f-44c2-9bce-6a1da65e85a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:13.838469 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1126691e-9e8f-44c2-9bce-6a1da65e85a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:13.840945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=42 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:13.846617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1126691e-9e8f-44c2-9bce-6a1da65e85a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:13.847079 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1126691e-9e8f-44c2-9bce-6a1da65e85a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:13.847878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1126691e-9e8f-44c2-9bce-6a1da65e85a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:13.848350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1126691e-9e8f-44c2-9bce-6a1da65e85a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:13.998387 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1126691e-9e8f-44c2-9bce-6a1da65e85a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:14.007251 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1126691e-9e8f-44c2-9bce-6a1da65e85a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.173874 Jul 21 08:35:14.007846 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 342/677] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:13 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:15.024420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f45b842e-401f-4b3e-a519-9f88d07f908e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:15.025050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f45b842e-401f-4b3e-a519-9f88d07f908e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:15.031055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f45b842e-401f-4b3e-a519-9f88d07f908e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:15.031535 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f45b842e-401f-4b3e-a519-9f88d07f908e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:15.032303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f45b842e-401f-4b3e-a519-9f88d07f908e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:15.032736 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f45b842e-401f-4b3e-a519-9f88d07f908e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:15.181353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f45b842e-401f-4b3e-a519-9f88d07f908e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:15.189205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f45b842e-401f-4b3e-a519-9f88d07f908e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.169214 Jul 21 08:35:15.189775 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 336/678] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:15 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:16.207710 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-44ea8fb6-4e91-45ea-95c0-4b950c1b3fbb tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:16.208428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-44ea8fb6-4e91-45ea-95c0-4b950c1b3fbb tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:16.214947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44ea8fb6-4e91-45ea-95c0-4b950c1b3fbb tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:16.215412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44ea8fb6-4e91-45ea-95c0-4b950c1b3fbb tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:16.216179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44ea8fb6-4e91-45ea-95c0-4b950c1b3fbb tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:16.216620 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44ea8fb6-4e91-45ea-95c0-4b950c1b3fbb tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:16.515888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-44ea8fb6-4e91-45ea-95c0-4b950c1b3fbb tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:16.524077 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-44ea8fb6-4e91-45ea-95c0-4b950c1b3fbb tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.320363 Jul 21 08:35:16.524689 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 343/679] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:16 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:17.541638 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e1e0be76-30c0-4805-a7d8-bd56e24ea121 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:17.542246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e1e0be76-30c0-4805-a7d8-bd56e24ea121 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:17.548392 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1e0be76-30c0-4805-a7d8-bd56e24ea121 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:17.548845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1e0be76-30c0-4805-a7d8-bd56e24ea121 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:17.549600 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1e0be76-30c0-4805-a7d8-bd56e24ea121 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:17.550035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1e0be76-30c0-4805-a7d8-bd56e24ea121 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:17.690641 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e1e0be76-30c0-4805-a7d8-bd56e24ea121 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:17.699816 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e1e0be76-30c0-4805-a7d8-bd56e24ea121 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.161907 Jul 21 08:35:17.700468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 337/680] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:17 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:18.717979 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a55fe089-016a-4dcd-9ddc-5bba318c7fdc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:18.718567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a55fe089-016a-4dcd-9ddc-5bba318c7fdc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:18.725807 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55fe089-016a-4dcd-9ddc-5bba318c7fdc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:18.726321 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55fe089-016a-4dcd-9ddc-5bba318c7fdc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:18.726956 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55fe089-016a-4dcd-9ddc-5bba318c7fdc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:18.727413 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55fe089-016a-4dcd-9ddc-5bba318c7fdc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:18.742900 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:35:18.743430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:35:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:35:18.872740 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a55fe089-016a-4dcd-9ddc-5bba318c7fdc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:18.881335 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a55fe089-016a-4dcd-9ddc-5bba318c7fdc tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1756 microversion: 2.1 time: 0.167202 Jul 21 08:35:18.881928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 344/681] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:18 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:19.900225 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b064e82-c55d-425f-8411-a42d3837892a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:19.900835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6b064e82-c55d-425f-8411-a42d3837892a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:19.907871 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b064e82-c55d-425f-8411-a42d3837892a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:19.908327 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b064e82-c55d-425f-8411-a42d3837892a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:19.909107 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b064e82-c55d-425f-8411-a42d3837892a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:19.909549 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b064e82-c55d-425f-8411-a42d3837892a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:20.060556 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6b064e82-c55d-425f-8411-a42d3837892a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:20.069455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6b064e82-c55d-425f-8411-a42d3837892a tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1759 microversion: 2.1 time: 0.173080 Jul 21 08:35:20.070025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 338/682] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:19 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:27.745565 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6dac7727-df3e-4dd0-8822-141d4e0a8dfa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:27.746058 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6dac7727-df3e-4dd0-8822-141d4e0a8dfa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:27.752072 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6dac7727-df3e-4dd0-8822-141d4e0a8dfa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:27.752511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6dac7727-df3e-4dd0-8822-141d4e0a8dfa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:27.753511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6dac7727-df3e-4dd0-8822-141d4e0a8dfa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:27.753940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6dac7727-df3e-4dd0-8822-141d4e0a8dfa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:27.756330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=89 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:27.782295 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6dac7727-df3e-4dd0-8822-141d4e0a8dfa tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments/eb9e246e-52b0-440a-bdb8-abbb6de34d48" status: 200 len: 194 microversion: 2.20 time: 0.148139 Jul 21 08:35:27.782861 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 345/683] 10.222.0.47 () {60 vars in 1453 bytes} [Thu Jul 21 08:35:27 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments/eb9e246e-52b0-440a-bdb8-abbb6de34d48 => generated 194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:35:27.843705 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-afb472e7-5994-4f52-83b1-e226b2d7b176 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:27.844202 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-afb472e7-5994-4f52-83b1-e226b2d7b176 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:27.850881 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afb472e7-5994-4f52-83b1-e226b2d7b176 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:27.851306 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afb472e7-5994-4f52-83b1-e226b2d7b176 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:27.852082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afb472e7-5994-4f52-83b1-e226b2d7b176 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:27.852510 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afb472e7-5994-4f52-83b1-e226b2d7b176 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:27.932705 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-afb472e7-5994-4f52-83b1-e226b2d7b176 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lazy-loading 'services' on Instance uuid f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:35:28.053134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-afb472e7-5994-4f52-83b1-e226b2d7b176 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments/eb9e246e-52b0-440a-bdb8-abbb6de34d48" status: 202 len: 0 microversion: 2.20 time: 0.213183 Jul 21 08:35:28.053796 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 339/684] 10.222.0.47 () {60 vars in 1456 bytes} [Thu Jul 21 08:35:27 2022] DELETE /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments/eb9e246e-52b0-440a-bdb8-abbb6de34d48 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:35:28.062937 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8ea73724-a629-4f4d-8d3c-f78d309a0715 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:28.063962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8ea73724-a629-4f4d-8d3c-f78d309a0715 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:28.070162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ea73724-a629-4f4d-8d3c-f78d309a0715 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:28.070610 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ea73724-a629-4f4d-8d3c-f78d309a0715 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:28.071408 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ea73724-a629-4f4d-8d3c-f78d309a0715 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:28.071847 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ea73724-a629-4f4d-8d3c-f78d309a0715 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:28.102779 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8ea73724-a629-4f4d-8d3c-f78d309a0715 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043604 Jul 21 08:35:28.103089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 346/685] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 21 08:35:28 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 08:35:29.114909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3c9257e4-20b9-45b5-a517-c3a821f72287 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:29.115829 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3c9257e4-20b9-45b5-a517-c3a821f72287 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:29.122670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c9257e4-20b9-45b5-a517-c3a821f72287 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:29.123113 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c9257e4-20b9-45b5-a517-c3a821f72287 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:29.123902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c9257e4-20b9-45b5-a517-c3a821f72287 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:29.124326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c9257e4-20b9-45b5-a517-c3a821f72287 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:29.149210 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:29.153967 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3c9257e4-20b9-45b5-a517-c3a821f72287 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043484 Jul 21 08:35:29.154552 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 340/686] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 21 08:35:29 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:29.211494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-77ebd125-1df7-4b00-bc3f-bd83c7347c0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:29.211991 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-77ebd125-1df7-4b00-bc3f-bd83c7347c0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:29.218673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77ebd125-1df7-4b00-bc3f-bd83c7347c0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:29.219120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77ebd125-1df7-4b00-bc3f-bd83c7347c0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:29.219921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77ebd125-1df7-4b00-bc3f-bd83c7347c0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:29.220358 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77ebd125-1df7-4b00-bc3f-bd83c7347c0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:29.247390 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-77ebd125-1df7-4b00-bc3f-bd83c7347c0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:35:29.325886 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-77ebd125-1df7-4b00-bc3f-bd83c7347c0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 204 len: 0 microversion: 2.20 time: 0.117871 Jul 21 08:35:29.326572 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 347/687] 10.222.0.47 () {60 vars in 1279 bytes} [Thu Jul 21 08:35:29 2022] DELETE /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 08:35:29.335001 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:29.335655 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:29.342593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:29.343038 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:29.343845 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:29.344281 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:29.473913 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:29.482851 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:29.484362 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:29.485508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b1bafe63-78e7-4135-ba4d-77f05268eb09 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.154393 Jul 21 08:35:29.486062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 341/688] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:29 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:35:30.505955 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:30.506646 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:30.513595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:30.514029 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:30.514772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:30.515211 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:30.652687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:30.660663 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:30.662173 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:30.663368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fbe97e1c-1521-48da-84a3-f8e50d845eb8 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1722 microversion: 2.20 time: 0.161950 Jul 21 08:35:30.663936 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 348/689] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:30 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:31.681829 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:31.682468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:31.688791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:31.689234 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:31.690016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:31.690480 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:31.753770 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:31.762681 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:31.764214 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:31.765354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dcf5c11c-28fb-40fc-8f6f-906a9ced7dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1655 microversion: 2.20 time: 0.087488 Jul 21 08:35:31.766076 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 342/690] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:31 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:32.294536 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-0e232222-1b94-4de6-92cc-3f7f4786d81a req-be207abf-cc08-4c65-abbd-bc59f627edaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a", "name": "network-vif-deleted", "tag": "dc3ec772-1aa6-40c5-a783-9c70e0e921dd"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:32.305687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-0e232222-1b94-4de6-92cc-3f7f4786d81a req-be207abf-cc08-4c65-abbd-bc59f627edaf service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:32.306182 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-0e232222-1b94-4de6-92cc-3f7f4786d81a req-be207abf-cc08-4c65-abbd-bc59f627edaf service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:32.320783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-0e232222-1b94-4de6-92cc-3f7f4786d81a req-be207abf-cc08-4c65-abbd-bc59f627edaf service nova] Creating event network-vif-deleted:dc3ec772-1aa6-40c5-a783-9c70e0e921dd for instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a on hv-cinder-85032 Jul 21 08:35:32.326752 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-0e232222-1b94-4de6-92cc-3f7f4786d81a req-be207abf-cc08-4c65-abbd-bc59f627edaf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041045 Jul 21 08:35:32.327976 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 349/691] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:35:32.785399 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:32.786147 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:32.793755 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:32.794255 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:32.795019 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:32.795490 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:32.829103 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:32.829551 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:32.830010 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lazy-loading 'fault' on Instance uuid f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:35:32.879493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:32.891127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:32.894006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:32.895537 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fe1d26e5-de10-403b-8837-92f84985738a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 200 len: 1371 microversion: 2.20 time: 0.116055 Jul 21 08:35:32.896822 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 343/692] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:32 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:33.915291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:33.916827 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:33.925770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:33.926617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:33.927629 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:33.928073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:33.945044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] HTTP exception thrown: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Request method failure captured: Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a HTTP/1.1 Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q6ZOMfudscQ2Kh_r70ZRWGXQGjq69QGoK_aI9kiCEtK8umxXBPaACcUp2U_rNvd-cmwPp80OZBOsaSZRfXifS3-JvSB4YrqAapxQvyXO3qykYZcpzAPtWABRpOI_WoxfEXtj2V9gSlyrLf0mwPpMOaoDkpCIP3FnlNXd0BH3YSJrX8 Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:35:33.946738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1bae82711d354d908d096edaae82c2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: ad56309db7044cb2a86651d4149cd090 Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:35:33.948474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a'} Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:35:33.949339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:35:33.950596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:35:33.951733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Returning 404 to user: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:35:33.951733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-83ab3caa-c8e6-4b8e-844f-5f19be30b510 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 404 len: 111 microversion: 2.20 time: 0.037779 Jul 21 08:35:33.951733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 350/693] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:33 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:35:33.957384 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf56bff7-61c5-4541-9269-d2b96e3aa63e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '.version_select at 0x7f65c0d5af70>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:33.981276 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf56bff7-61c5-4541-9269-d2b96e3aa63e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814532123" status: 204 len: 0 microversion: 2.20 time: 0.027724 Jul 21 08:35:33.981865 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 344/694] 10.222.0.47 () {60 vars in 1261 bytes} [Thu Jul 21 08:35:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814532123 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 08:35:34.656721 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b708ef67-a7a7-4437-afc7-5632a6526f0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'create', calling method: .version_select at 0x7f65bc401ca0>, body: {"keypair": {"name": "tempest-keypair-1758411173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH62M/fHGy60RDGnRi74O8LFdbZrW2nm57236UIsnDiaG722mu+xMDl3FX/8Mm49LOik2hBGD+kpoeCVQKgwiCC8+jSsMefo9pGfu5h98LB76stw2PdYzhqSkqQ0iaf0NQ=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:34.671197 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-b708ef67-a7a7-4437-afc7-5632a6526f0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Getting quotas for project 1bae82711d354d908d096edaae82c2c5. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:35:34.675549 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-b708ef67-a7a7-4437-afc7-5632a6526f0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Getting quotas for user ad56309db7044cb2a86651d4149cd090 and project 1bae82711d354d908d096edaae82c2c5. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:35:34.700581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b708ef67-a7a7-4437-afc7-5632a6526f0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047795 Jul 21 08:35:34.701478 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 351/695] 10.222.0.47 () {62 vars in 1199 bytes} [Thu Jul 21 08:35:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 08:35:36.176455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1566018943", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0007c58-da18-4da3-9b44-02b8eac8163c"}], "security_groups": [{"name": "tempest-securitygroup--1871896008"}], "key_name": "tempest-keypair-1758411173", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:36.279494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] validate_networks() for [('f0007c58-da18-4da3-9b44-02b8eac8163c', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:35:36.709409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:35:36.709827 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:35:36.710289 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:35:36.710685 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:35:36.711085 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:35:36.720621 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:36.721124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:36.721958 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:36.722403 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:36.739024 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Getting quotas for project 1bae82711d354d908d096edaae82c2c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:35:36.743030 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Getting quotas for user ad56309db7044cb2a86651d4149cd090 and project 1bae82711d354d908d096edaae82c2c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:35:36.754168 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:35:36.756468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:35:36.803159 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-70184d6d-b02a-4c19-8c4c-446d68d660cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.631331 Jul 21 08:35:36.803951 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 345/696] 10.222.0.47 () {62 vars in 1187 bytes} [Thu Jul 21 08:35:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 08:35:36.814898 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-37115660-e7a3-4378-a188-2136186c4e8d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:36.815646 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-37115660-e7a3-4378-a188-2136186c4e8d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:36.875280 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-37115660-e7a3-4378-a188-2136186c4e8d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:36.883259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-37115660-e7a3-4378-a188-2136186c4e8d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:36.885356 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-37115660-e7a3-4378-a188-2136186c4e8d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:36.886674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-37115660-e7a3-4378-a188-2136186c4e8d tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1282 microversion: 2.20 time: 0.076195 Jul 21 08:35:36.887236 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 352/697] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:36 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:37.904803 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:37.905521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:37.912490 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:37.913021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:37.913870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:37.914360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:37.981717 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:37.990122 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:37.991980 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:37.993471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f89c69f7-48b7-4ac6-8b82-0c0d7d569a58 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1342 microversion: 2.20 time: 0.093376 Jul 21 08:35:37.994295 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 346/698] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:37 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:39.014382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:39.015014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:39.022671 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:39.023184 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:39.024006 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:39.024445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:39.216872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:39.225079 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:39.226563 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:39.227705 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1fc896e6-2e6d-402e-ae79-8a04969aba32 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1408 microversion: 2.20 time: 0.217639 Jul 21 08:35:39.228864 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 353/699] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:39 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:39.326211 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-22349837-ac9a-44d0-983a-7817d8c921ef req-77737b5f-8ee4-4c70-8ea9-f8670b75bfde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207a7a3d-14f0-48b6-8ec4-d92b508659d3", "tag": "5aa7f4fc-7261-46b3-85e6-fd60be720151"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:39.333649 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:39.343894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-22349837-ac9a-44d0-983a-7817d8c921ef req-77737b5f-8ee4-4c70-8ea9-f8670b75bfde service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:39.344430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-22349837-ac9a-44d0-983a-7817d8c921ef req-77737b5f-8ee4-4c70-8ea9-f8670b75bfde service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:39.358397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-22349837-ac9a-44d0-983a-7817d8c921ef req-77737b5f-8ee4-4c70-8ea9-f8670b75bfde service nova] Creating event network-changed:5aa7f4fc-7261-46b3-85e6-fd60be720151 for instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 on hv-cinder-85032 Jul 21 08:35:39.368390 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-22349837-ac9a-44d0-983a-7817d8c921ef req-77737b5f-8ee4-4c70-8ea9-f8670b75bfde service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046126 Jul 21 08:35:39.369169 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 347/700] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:35:40.246730 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:40.247243 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:40.253975 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:40.254423 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:40.255178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:40.255643 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:40.387283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:40.395127 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:40.396683 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:40.397779 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d6ab0dd3-4402-4f16-a99f-52ebf37b381c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1408 microversion: 2.20 time: 0.155571 Jul 21 08:35:40.398331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 354/701] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:40 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:41.416605 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:41.417394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:41.423579 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:41.424012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:41.424762 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:41.425183 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:41.557685 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:41.565678 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:41.567182 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:41.568315 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-91a00310-8a7b-439b-9b9e-552eb437bc2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1408 microversion: 2.20 time: 0.156592 Jul 21 08:35:41.568877 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 348/702] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:41 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:42.586002 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:42.586606 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:42.593708 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:42.594154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:42.594911 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:42.595361 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:42.730137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:42.738121 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:42.739657 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:42.740775 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f8f5e559-24c2-49a1-9b8f-2cd8846660e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1408 microversion: 2.20 time: 0.158655 Jul 21 08:35:42.741341 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 355/703] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:42 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:43.758405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:43.759021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:43.764928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:43.765367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:43.766116 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:43.766576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:43.897891 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:43.906295 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:43.907821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:43.908918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-425b7d4f-1c3b-4112-afd4-8225fece782a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1408 microversion: 2.20 time: 0.154553 Jul 21 08:35:43.909494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 349/704] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:43 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:44.460274 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-be54905a-c660-4928-a4a7-00720d7c0746 req-7f1b211a-82a5-4d3f-9505-a431bc4365ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207a7a3d-14f0-48b6-8ec4-d92b508659d3", "name": "network-vif-plugged", "status": "completed", "tag": "5aa7f4fc-7261-46b3-85e6-fd60be720151"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:44.464989 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:44.470753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-be54905a-c660-4928-a4a7-00720d7c0746 req-7f1b211a-82a5-4d3f-9505-a431bc4365ee service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:44.471203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-be54905a-c660-4928-a4a7-00720d7c0746 req-7f1b211a-82a5-4d3f-9505-a431bc4365ee service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:44.486878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-be54905a-c660-4928-a4a7-00720d7c0746 req-7f1b211a-82a5-4d3f-9505-a431bc4365ee service nova] Creating event network-vif-plugged:5aa7f4fc-7261-46b3-85e6-fd60be720151 for instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 on hv-cinder-85032 Jul 21 08:35:44.492239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-be54905a-c660-4928-a4a7-00720d7c0746 req-7f1b211a-82a5-4d3f-9505-a431bc4365ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035841 Jul 21 08:35:44.493079 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 356/705] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:35:44.926302 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:44.926817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:44.933664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:44.934106 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:44.934868 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:44.935297 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:45.069631 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:45.077646 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:45.079145 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:45.080402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae26d881-973a-41eb-bd6e-f873237b4d5a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1408 microversion: 2.20 time: 0.157920 Jul 21 08:35:45.080991 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 350/706] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:44 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:46.099433 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:46.100141 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:46.106389 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:46.106834 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:46.107634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:46.108071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:46.239115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:46.247596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:46.249112 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:46.250271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3f46f38e-ed07-42c0-94f0-1d4c5ddaabe6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1600 microversion: 2.20 time: 0.155696 Jul 21 08:35:46.250829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 357/707] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:35:46 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:35:46.268446 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1a6aaba1-a0e0-4d1f-95e1-bad904c93a0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:46.269099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1a6aaba1-a0e0-4d1f-95e1-bad904c93a0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:46.274915 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a6aaba1-a0e0-4d1f-95e1-bad904c93a0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:46.275387 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a6aaba1-a0e0-4d1f-95e1-bad904c93a0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:46.276172 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a6aaba1-a0e0-4d1f-95e1-bad904c93a0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:46.276609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a6aaba1-a0e0-4d1f-95e1-bad904c93a0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:46.354175 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1a6aaba1-a0e0-4d1f-95e1-bad904c93a0e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089581 Jul 21 08:35:46.355013 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 351/708] 10.222.0.47 () {60 vars in 1315 bytes} [Thu Jul 21 08:35:46 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:35:47.287707 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:47.344547 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-626c22fa-03ea-44d0-9b3a-11eb6ec43b8f req-e8bb110b-bdf6-4f5b-b4fe-eee23d96dee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207a7a3d-14f0-48b6-8ec4-d92b508659d3", "tag": "5aa7f4fc-7261-46b3-85e6-fd60be720151"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:47.352638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-626c22fa-03ea-44d0-9b3a-11eb6ec43b8f req-e8bb110b-bdf6-4f5b-b4fe-eee23d96dee8 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:47.353170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-626c22fa-03ea-44d0-9b3a-11eb6ec43b8f req-e8bb110b-bdf6-4f5b-b4fe-eee23d96dee8 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:47.364617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-626c22fa-03ea-44d0-9b3a-11eb6ec43b8f req-e8bb110b-bdf6-4f5b-b4fe-eee23d96dee8 service nova] Creating event network-changed:5aa7f4fc-7261-46b3-85e6-fd60be720151 for instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 on hv-cinder-85032 Jul 21 08:35:47.369900 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-626c22fa-03ea-44d0-9b3a-11eb6ec43b8f req-e8bb110b-bdf6-4f5b-b4fe-eee23d96dee8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086458 Jul 21 08:35:47.370609 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 358/709] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:35:50.443868 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:50.444629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:50.449220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f5996774-e4eb-4779-88f6-4249febf33d3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:50.449709 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f5996774-e4eb-4779-88f6-4249febf33d3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:50.456571 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5996774-e4eb-4779-88f6-4249febf33d3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:50.457022 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5996774-e4eb-4779-88f6-4249febf33d3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:50.457780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5996774-e4eb-4779-88f6-4249febf33d3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:50.458213 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5996774-e4eb-4779-88f6-4249febf33d3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:50.537477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-f5996774-e4eb-4779-88f6-4249febf33d3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lazy-loading 'services' on Instance uuid 6e1747f3-79a3-4e2d-bda8-49fec0b5018a {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:35:50.611411 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f5996774-e4eb-4779-88f6-4249febf33d3 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments/2cd03fd3-2b63-40bc-a02b-3daa9a0d46ba" status: 202 len: 0 microversion: 2.1 time: 0.168099 Jul 21 08:35:50.611995 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 352/710] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:35:50 2022] DELETE /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments/2cd03fd3-2b63-40bc-a02b-3daa9a0d46ba => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:35:50.622623 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fa5d9d9a-f5c6-4fce-8d78-1cca1dd78e15 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:50.623674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fa5d9d9a-f5c6-4fce-8d78-1cca1dd78e15 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:50.631624 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa5d9d9a-f5c6-4fce-8d78-1cca1dd78e15 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:50.632154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa5d9d9a-f5c6-4fce-8d78-1cca1dd78e15 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:50.632966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa5d9d9a-f5c6-4fce-8d78-1cca1dd78e15 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:50.633412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa5d9d9a-f5c6-4fce-8d78-1cca1dd78e15 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:50.664554 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fa5d9d9a-f5c6-4fce-8d78-1cca1dd78e15 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Jul 21 08:35:50.665130 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 359/711] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:35:50 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:35:51.676981 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8c17e702-19e1-47ea-9c88-8e118254f3ab tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:51.677989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8c17e702-19e1-47ea-9c88-8e118254f3ab tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:51.684226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c17e702-19e1-47ea-9c88-8e118254f3ab tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:51.684671 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c17e702-19e1-47ea-9c88-8e118254f3ab tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:51.685430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c17e702-19e1-47ea-9c88-8e118254f3ab tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:51.685860 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c17e702-19e1-47ea-9c88-8e118254f3ab tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:51.714503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8c17e702-19e1-47ea-9c88-8e118254f3ab tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041776 Jul 21 08:35:51.715062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 353/712] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:35:51 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:35:51.790396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ddaaefe3-b105-46a7-a2ac-d8194aa57d44 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:51.790911 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ddaaefe3-b105-46a7-a2ac-d8194aa57d44 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:51.797283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ddaaefe3-b105-46a7-a2ac-d8194aa57d44 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:51.797723 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ddaaefe3-b105-46a7-a2ac-d8194aa57d44 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:51.798476 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ddaaefe3-b105-46a7-a2ac-d8194aa57d44 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:51.798905 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ddaaefe3-b105-46a7-a2ac-d8194aa57d44 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:51.823738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ddaaefe3-b105-46a7-a2ac-d8194aa57d44 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:35:51.901784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ddaaefe3-b105-46a7-a2ac-d8194aa57d44 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 204 len: 0 microversion: 2.1 time: 0.114867 Jul 21 08:35:51.902464 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 360/713] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:35:51 2022] DELETE /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:35:51.910426 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-990a6375-6846-4531-a851-67090e1ace9d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:51.911064 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-990a6375-6846-4531-a851-67090e1ace9d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:51.917169 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-990a6375-6846-4531-a851-67090e1ace9d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:51.917616 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-990a6375-6846-4531-a851-67090e1ace9d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:51.918369 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-990a6375-6846-4531-a851-67090e1ace9d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:51.918804 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-990a6375-6846-4531-a851-67090e1ace9d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:52.045623 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-990a6375-6846-4531-a851-67090e1ace9d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:52.053004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-990a6375-6846-4531-a851-67090e1ace9d tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1689 microversion: 2.1 time: 0.146425 Jul 21 08:35:52.053572 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 354/714] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:51 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:35:53.070781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-edb616ec-1c54-4914-870d-5a0378bace77 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:53.073754 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-edb616ec-1c54-4914-870d-5a0378bace77 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:53.081862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edb616ec-1c54-4914-870d-5a0378bace77 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:53.082323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edb616ec-1c54-4914-870d-5a0378bace77 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:53.083103 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edb616ec-1c54-4914-870d-5a0378bace77 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:53.083550 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edb616ec-1c54-4914-870d-5a0378bace77 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:53.218153 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-edb616ec-1c54-4914-870d-5a0378bace77 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:53.229481 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-edb616ec-1c54-4914-870d-5a0378bace77 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1689 microversion: 2.1 time: 0.162526 Jul 21 08:35:53.230479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 361/715] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:53 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:54.248823 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a120a73-c18a-4369-b85a-b9bf1117f1d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:54.249439 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a120a73-c18a-4369-b85a-b9bf1117f1d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:54.255774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a120a73-c18a-4369-b85a-b9bf1117f1d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:54.256220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a120a73-c18a-4369-b85a-b9bf1117f1d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:54.256973 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a120a73-c18a-4369-b85a-b9bf1117f1d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:54.257406 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a120a73-c18a-4369-b85a-b9bf1117f1d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:54.388269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a120a73-c18a-4369-b85a-b9bf1117f1d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:54.395627 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a120a73-c18a-4369-b85a-b9bf1117f1d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1689 microversion: 2.1 time: 0.150640 Jul 21 08:35:54.396189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 355/716] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:54 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:55.412860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cc2f7672-71a7-4290-b46e-c264fa92a160 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:55.413471 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cc2f7672-71a7-4290-b46e-c264fa92a160 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:55.420500 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc2f7672-71a7-4290-b46e-c264fa92a160 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:55.421116 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc2f7672-71a7-4290-b46e-c264fa92a160 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:55.421944 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc2f7672-71a7-4290-b46e-c264fa92a160 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:55.422379 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc2f7672-71a7-4290-b46e-c264fa92a160 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:55.642202 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc2f7672-71a7-4290-b46e-c264fa92a160 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:55.650058 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cc2f7672-71a7-4290-b46e-c264fa92a160 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1689 microversion: 2.1 time: 0.241043 Jul 21 08:35:55.650639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 362/717] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:55 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:35:56.630713 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-eb77f504-d603-4a61-a3d7-509084e74a50 req-2b836cec-a5a6-4779-8ab0-a0aa04d8b235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1747f3-79a3-4e2d-bda8-49fec0b5018a", "name": "network-vif-deleted", "tag": "ef56d972-ef7d-4c22-ae07-b6fd0167acb2"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:56.639515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-eb77f504-d603-4a61-a3d7-509084e74a50 req-2b836cec-a5a6-4779-8ab0-a0aa04d8b235 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:56.639936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-eb77f504-d603-4a61-a3d7-509084e74a50 req-2b836cec-a5a6-4779-8ab0-a0aa04d8b235 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:56.651071 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-eb77f504-d603-4a61-a3d7-509084e74a50 req-2b836cec-a5a6-4779-8ab0-a0aa04d8b235 service nova] Creating event network-vif-deleted:ef56d972-ef7d-4c22-ae07-b6fd0167acb2 for instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a on hv-cinder-85032 Jul 21 08:35:56.656362 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-eb77f504-d603-4a61-a3d7-509084e74a50 req-2b836cec-a5a6-4779-8ab0-a0aa04d8b235 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093379 Jul 21 08:35:56.657505 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 356/718] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:35:56.667920 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:56.669289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:56.677552 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:56.678090 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:56.679549 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:56.680081 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:56.685187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:56.716378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:56.716956 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:56.717439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lazy-loading 'fault' on Instance uuid 6e1747f3-79a3-4e2d-bda8-49fec0b5018a {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:35:56.759715 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:35:56.767265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a0567011-9466-4700-bf0f-f9d7522e0e0e tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 200 len: 1335 microversion: 2.1 time: 0.103483 Jul 21 08:35:56.767864 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 363/719] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:56 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:35:57.784942 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:57.785538 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 6e1747f3-79a3-4e2d-bda8-49fec0b5018a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:57.791718 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:57.792151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:57.792896 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:57.793318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:57.805827 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] HTTP exception thrown: Instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a could not be found. Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Request method failure captured: Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a HTTP/1.1 Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6iM3ePdQNOYU9NrpZdSW4k5-tepkW1LXnF6xRNHWXzWwVe2K6dnDtR3dekzKN6kda1f2LJgjvXP36sczxR0S88U2jjKCXvgq3JucN9neKfptczv3FD2wZGwDlmv9_n-KoklrOHHAuEWSWzSa1xT8JTkbN_FOiRQDDENLNKjXqTGOg Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:35:57.807455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 3528104f3e914d62a10e80e13d3c97de Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a could not be found. Jul 21 08:35:57.809080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '6e1747f3-79a3-4e2d-bda8-49fec0b5018a'} Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a could not be found. Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:35:57.810074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a could not be found. Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a could not be found. Jul 21 08:35:57.811593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:35:57.812870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Returning 404 to user: Instance 6e1747f3-79a3-4e2d-bda8-49fec0b5018a could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:35:57.812870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62226dac-14e4-4b1c-ae24-5d24df644171 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a" status: 404 len: 111 microversion: 2.1 time: 0.028168 Jul 21 08:35:57.812870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 357/720] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:35:57 2022] GET /compute/v2.1/servers/6e1747f3-79a3-4e2d-bda8-49fec0b5018a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:35:57.817739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-52a9267a-d548-4d97-8030-73e9295dc53b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '.version_select at 0x7f65bc3b6a60>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:35:57.836469 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-52a9267a-d548-4d97-8030-73e9295dc53b tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689372369" status: 202 len: 0 microversion: 2.1 time: 0.022473 Jul 21 08:35:57.837593 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 364/721] 10.222.0.47 () {58 vars in 1220 bytes} [Thu Jul 21 08:35:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689372369 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:35:58.872414 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8180ac35-1555-4c6e-b82c-d20abc43f1a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1557292706"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:58.872986 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8180ac35-1555-4c6e-b82c-d20abc43f1a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:35:58.879297 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8180ac35-1555-4c6e-b82c-d20abc43f1a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:58.879763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8180ac35-1555-4c6e-b82c-d20abc43f1a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:58.880519 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8180ac35-1555-4c6e-b82c-d20abc43f1a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:58.880944 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8180ac35-1555-4c6e-b82c-d20abc43f1a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:59.016226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.network.security_group_api [None req-8180ac35-1555-4c6e-b82c-d20abc43f1a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Removing security group e6e96a3e-da8d-47b2-82f2-45d26c23a08b from port 2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 Jul 21 08:35:59.360767 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8180ac35-1555-4c6e-b82c-d20abc43f1a3 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "POST /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/action" status: 202 len: 0 microversion: 2.1 time: 0.492136 Jul 21 08:35:59.362436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 358/722] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:35:58 2022] POST /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:35:59.369479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-c0dd4d29-48e1-4903-8340-c29a02d5218a req-09f30332-f12f-4a91-8b59-42a1f74005bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9611775-7996-4da2-aa8b-5ef9d642cade", "tag": "2d38ba9b-48d8-48b8-bb69-f7ae8db202d3"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:35:59.381553 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-c0dd4d29-48e1-4903-8340-c29a02d5218a req-09f30332-f12f-4a91-8b59-42a1f74005bc service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:35:59.382206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-c0dd4d29-48e1-4903-8340-c29a02d5218a req-09f30332-f12f-4a91-8b59-42a1f74005bc service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:35:59.401392 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-c0dd4d29-48e1-4903-8340-c29a02d5218a req-09f30332-f12f-4a91-8b59-42a1f74005bc service nova] Creating event network-changed:2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 for instance e9611775-7996-4da2-aa8b-5ef9d642cade on hv-cinder-85032 Jul 21 08:35:59.413534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-c0dd4d29-48e1-4903-8340-c29a02d5218a req-09f30332-f12f-4a91-8b59-42a1f74005bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048176 Jul 21 08:35:59.414513 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 365/723] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:00.740656 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cbadbdfb-8a16-4693-9023-31520ab9a524 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:00.741246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cbadbdfb-8a16-4693-9023-31520ab9a524 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:00.748193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbadbdfb-8a16-4693-9023-31520ab9a524 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:00.748639 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbadbdfb-8a16-4693-9023-31520ab9a524 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:00.749420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbadbdfb-8a16-4693-9023-31520ab9a524 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:00.749857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbadbdfb-8a16-4693-9023-31520ab9a524 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:00.752839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:00.777664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cbadbdfb-8a16-4693-9023-31520ab9a524 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:36:00.867109 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cbadbdfb-8a16-4693-9023-31520ab9a524 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 204 len: 0 microversion: 2.1 time: 0.130118 Jul 21 08:36:00.868084 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 359/724] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:36:00 2022] DELETE /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:36:00.883936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9831bee7-eb87-49da-be60-4ff39d785153 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:00.884607 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9831bee7-eb87-49da-be60-4ff39d785153 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:00.885806 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2335a988-3bd0-437e-ad24-0df5a6bc895a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:00.886780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2335a988-3bd0-437e-ad24-0df5a6bc895a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:00.890962 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9831bee7-eb87-49da-be60-4ff39d785153 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:00.891565 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9831bee7-eb87-49da-be60-4ff39d785153 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:00.892609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9831bee7-eb87-49da-be60-4ff39d785153 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:00.892885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9831bee7-eb87-49da-be60-4ff39d785153 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:00.893970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2335a988-3bd0-437e-ad24-0df5a6bc895a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:00.894512 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2335a988-3bd0-437e-ad24-0df5a6bc895a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:00.895558 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2335a988-3bd0-437e-ad24-0df5a6bc895a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:00.896216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2335a988-3bd0-437e-ad24-0df5a6bc895a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:00.995727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-9831bee7-eb87-49da-be60-4ff39d785153 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lazy-loading 'services' on Instance uuid e9611775-7996-4da2-aa8b-5ef9d642cade {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:36:01.038008 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2335a988-3bd0-437e-ad24-0df5a6bc895a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:01.046527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2335a988-3bd0-437e-ad24-0df5a6bc895a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1509 microversion: 2.1 time: 0.172700 Jul 21 08:36:01.047298 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 366/725] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:00 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:01.086258 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9831bee7-eb87-49da-be60-4ff39d785153 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments/d9d425eb-9b07-4512-97c9-290eba2ffd48" status: 202 len: 0 microversion: 2.1 time: 0.206769 Jul 21 08:36:01.086954 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 360/726] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:36:00 2022] DELETE /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments/d9d425eb-9b07-4512-97c9-290eba2ffd48 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 08:36:01.096796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c6a792dc-b5d3-434e-80f7-64d7770be646 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:01.097842 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c6a792dc-b5d3-434e-80f7-64d7770be646 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:01.105428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6a792dc-b5d3-434e-80f7-64d7770be646 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:01.106162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6a792dc-b5d3-434e-80f7-64d7770be646 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:01.106946 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6a792dc-b5d3-434e-80f7-64d7770be646 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:01.107446 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6a792dc-b5d3-434e-80f7-64d7770be646 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:01.137705 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c6a792dc-b5d3-434e-80f7-64d7770be646 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Jul 21 08:36:01.138276 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 367/727] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:36:01 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:01.429444 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-164a69b5-1896-4afa-8638-80077a037791 req-c1866a6e-d219-450d-bc77-09d1064deda6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9611775-7996-4da2-aa8b-5ef9d642cade", "tag": "2d38ba9b-48d8-48b8-bb69-f7ae8db202d3"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:01.438250 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-164a69b5-1896-4afa-8638-80077a037791 req-c1866a6e-d219-450d-bc77-09d1064deda6 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:01.438694 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-164a69b5-1896-4afa-8638-80077a037791 req-c1866a6e-d219-450d-bc77-09d1064deda6 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:01.450844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-164a69b5-1896-4afa-8638-80077a037791 req-c1866a6e-d219-450d-bc77-09d1064deda6 service nova] Creating event network-changed:2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 for instance e9611775-7996-4da2-aa8b-5ef9d642cade on hv-cinder-85032 Jul 21 08:36:01.456699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-164a69b5-1896-4afa-8638-80077a037791 req-c1866a6e-d219-450d-bc77-09d1064deda6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031181 Jul 21 08:36:01.457564 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 361/728] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:02.063444 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-34f044f2-6ab4-4568-b8d7-0904524118bb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:02.064002 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-34f044f2-6ab4-4568-b8d7-0904524118bb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:02.070570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34f044f2-6ab4-4568-b8d7-0904524118bb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:02.071024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34f044f2-6ab4-4568-b8d7-0904524118bb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:02.071833 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34f044f2-6ab4-4568-b8d7-0904524118bb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:02.072273 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34f044f2-6ab4-4568-b8d7-0904524118bb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:02.151087 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4dbf5ffc-b5c3-4bed-b640-c904551ca04e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:02.152220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4dbf5ffc-b5c3-4bed-b640-c904551ca04e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:02.158600 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4dbf5ffc-b5c3-4bed-b640-c904551ca04e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:02.159129 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4dbf5ffc-b5c3-4bed-b640-c904551ca04e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:02.159998 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4dbf5ffc-b5c3-4bed-b640-c904551ca04e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:02.160438 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4dbf5ffc-b5c3-4bed-b640-c904551ca04e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:02.189985 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4dbf5ffc-b5c3-4bed-b640-c904551ca04e tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043503 Jul 21 08:36:02.190753 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 362/729] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:36:02 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:36:02.203626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-34f044f2-6ab4-4568-b8d7-0904524118bb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:02.211238 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-34f044f2-6ab4-4568-b8d7-0904524118bb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1509 microversion: 2.1 time: 0.151767 Jul 21 08:36:02.211847 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 368/730] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:02 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:03.202106 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7055431-42a7-4e5c-a51e-7da564466b18 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:03.202916 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e7055431-42a7-4e5c-a51e-7da564466b18 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:03.208768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7055431-42a7-4e5c-a51e-7da564466b18 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:03.209201 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7055431-42a7-4e5c-a51e-7da564466b18 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:03.209943 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7055431-42a7-4e5c-a51e-7da564466b18 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:03.210365 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7055431-42a7-4e5c-a51e-7da564466b18 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:03.228623 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7ea68ebe-1808-4dad-8d5c-2e2d2fb02393 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:03.229321 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7ea68ebe-1808-4dad-8d5c-2e2d2fb02393 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:03.235793 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ea68ebe-1808-4dad-8d5c-2e2d2fb02393 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:03.236246 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ea68ebe-1808-4dad-8d5c-2e2d2fb02393 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:03.237010 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ea68ebe-1808-4dad-8d5c-2e2d2fb02393 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:03.237451 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ea68ebe-1808-4dad-8d5c-2e2d2fb02393 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:03.239781 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7055431-42a7-4e5c-a51e-7da564466b18 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041677 Jul 21 08:36:03.240338 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 363/731] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:36:03 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:03.367917 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7ea68ebe-1808-4dad-8d5c-2e2d2fb02393 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:03.376334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7ea68ebe-1808-4dad-8d5c-2e2d2fb02393 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1509 microversion: 2.1 time: 0.152113 Jul 21 08:36:03.377242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 369/732] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:03 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:03.918508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-54305155-6e3a-4c67-b82c-f044f497f9eb req-e7b6443c-abdc-4932-ad9a-a44ed597bf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284babfb-5c35-4312-ad28-7af7026b4f51", "name": "network-vif-deleted", "tag": "13bfbdd0-2bcd-4e96-9be4-7eea28463ac1"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:03.927967 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-54305155-6e3a-4c67-b82c-f044f497f9eb req-e7b6443c-abdc-4932-ad9a-a44ed597bf8d service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:03.928649 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-54305155-6e3a-4c67-b82c-f044f497f9eb req-e7b6443c-abdc-4932-ad9a-a44ed597bf8d service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:03.941586 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-54305155-6e3a-4c67-b82c-f044f497f9eb req-e7b6443c-abdc-4932-ad9a-a44ed597bf8d service nova] Creating event network-vif-deleted:13bfbdd0-2bcd-4e96-9be4-7eea28463ac1 for instance 284babfb-5c35-4312-ad28-7af7026b4f51 on hv-cinder-85032 Jul 21 08:36:03.947643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-54305155-6e3a-4c67-b82c-f044f497f9eb req-e7b6443c-abdc-4932-ad9a-a44ed597bf8d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Jul 21 08:36:03.948253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 364/733] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:04.251602 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-803446f9-11aa-4e94-9995-8d0bc3bd5f2c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:04.252552 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-803446f9-11aa-4e94-9995-8d0bc3bd5f2c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:04.260203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-803446f9-11aa-4e94-9995-8d0bc3bd5f2c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:04.260649 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-803446f9-11aa-4e94-9995-8d0bc3bd5f2c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:04.261442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-803446f9-11aa-4e94-9995-8d0bc3bd5f2c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:04.261870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-803446f9-11aa-4e94-9995-8d0bc3bd5f2c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:04.292072 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-803446f9-11aa-4e94-9995-8d0bc3bd5f2c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044427 Jul 21 08:36:04.292660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 370/734] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:36:04 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:36:04.302794 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:04.303580 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:04.310702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:04.311280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:04.312183 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:04.312721 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:04.389802 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] HTTP exception thrown: Instance e9611775-7996-4da2-aa8b-5ef9d642cade is not attached to volume d9d425eb-9b07-4512-97c9-290eba2ffd48 Jul 21 08:36:04.393924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:04.394551 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Request method failure captured: Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments/d9d425eb-9b07-4512-97c9-290eba2ffd48 HTTP/1.1 Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q9BcTzl3xpftQxHEdw0La7DRejqfH4sXWSiTj510LuNw4vyTmnDTFNOT2rPirAlw_RgjG_oCCvC83jhNwO330fOw9hqUPBMCXjo-akF9rlVbppPj1ZU41deTaOsW9c7tIKAQitRg-A7Z7-4KT7fzss0mxIgQINR2L8DqwjR8apdZms Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: a8ccb394622d4b24930f8b6396671857 Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestMinimumBasicScenario-1843914319 Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:36:04.398035 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a8ccb394622d4b24930f8b6396671857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a8ccb394622d4b24930f8b6396671857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a8ccb394622d4b24930f8b6396671857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a8ccb394622d4b24930f8b6396671857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestMinimumBasicScenario-1843914319 Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: a8ccb394622d4b24930f8b6396671857 Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1843914319 Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-TestMinimumBasicScenario-1843914319-project Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 8249ebd6b2dc4811ad315d54030d927e Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestMinimumBasicScenario-1843914319-project Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:36:04.399445 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance e9611775-7996-4da2-aa8b-5ef9d642cade is not attached to volume d9d425eb-9b07-4512-97c9-290eba2ffd48 Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'server_id': 'e9611775-7996-4da2-aa8b-5ef9d642cade', 'id': 'd9d425eb-9b07-4512-97c9-290eba2ffd48'} Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d9d425eb-9b07-4512-97c9-290eba2ffd48. Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:36:04.400766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9611775-7996-4da2-aa8b-5ef9d642cade is not attached to volume d9d425eb-9b07-4512-97c9-290eba2ffd48 Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9611775-7996-4da2-aa8b-5ef9d642cade is not attached to volume d9d425eb-9b07-4512-97c9-290eba2ffd48 Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:04.405821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Returning 404 to user: Instance e9611775-7996-4da2-aa8b-5ef9d642cade is not attached to volume d9d425eb-9b07-4512-97c9-290eba2ffd48 {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:36:04.406732 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f9fc5d2-5891-4d6c-869d-941f8cef087c tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments/d9d425eb-9b07-4512-97c9-290eba2ffd48" status: 404 len: 154 microversion: 2.1 time: 0.100973 Jul 21 08:36:04.406732 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 365/735] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:36:04 2022] DELETE /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade/os-volume_attachments/d9d425eb-9b07-4512-97c9-290eba2ffd48 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:36:04.406924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:04.406924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:04.406924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:04.406924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:04.440137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:04.440626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:04.441084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lazy-loading 'fault' on Instance uuid 284babfb-5c35-4312-ad28-7af7026b4f51 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:36:04.491317 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:04.499711 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d70540c9-efc1-4fc7-b92c-e38a9b99ba58 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 200 len: 1312 microversion: 2.1 time: 0.109569 Jul 21 08:36:04.500494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 371/736] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:04 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:05.517444 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:05.518126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: 284babfb-5c35-4312-ad28-7af7026b4f51] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:05.524158 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.525093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.525855 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.526292 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.539990 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] HTTP exception thrown: Instance 284babfb-5c35-4312-ad28-7af7026b4f51 could not be found. Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Request method failure captured: Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 HTTP/1.1 Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6iM3ePdQNOYU9NrpZdSW4k5-tepkW1LXnF6xRNHWXzWwVe2K6dnDtR3dekzKN6kda1f2LJgjvXP36sczxR0S88U2jjKCXvgq3JucN9neKfptczv3FD2wZGwDlmv9_n-KoklrOHHAuEWSWzSa1xT8JTkbN_FOiRQDDENLNKjXqTGOg Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:36:05.542204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 3528104f3e914d62a10e80e13d3c97de Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 284babfb-5c35-4312-ad28-7af7026b4f51 could not be found. Jul 21 08:36:05.543575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '284babfb-5c35-4312-ad28-7af7026b4f51'} Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284babfb-5c35-4312-ad28-7af7026b4f51 could not be found. Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:36:05.544325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284babfb-5c35-4312-ad28-7af7026b4f51 could not be found. Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284babfb-5c35-4312-ad28-7af7026b4f51 could not be found. Jul 21 08:36:05.545648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:05.546727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Returning 404 to user: Instance 284babfb-5c35-4312-ad28-7af7026b4f51 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:36:05.546727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2525da6-04c0-4b6a-87fd-07570e2604d6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51" status: 404 len: 111 microversion: 2.1 time: 0.030017 Jul 21 08:36:05.546727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 366/737] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:05 2022] GET /compute/v2.1/servers/284babfb-5c35-4312-ad28-7af7026b4f51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:36:05.549181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cafce98a-6e30-48c8-8dd9-e72ad8628220 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:05.549743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cafce98a-6e30-48c8-8dd9-e72ad8628220 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:05.553077 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-09bef60e-32a3-4e49-991d-53adecf6dcb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:05.553649 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09bef60e-32a3-4e49-991d-53adecf6dcb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:05.556334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cafce98a-6e30-48c8-8dd9-e72ad8628220 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.556792 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cafce98a-6e30-48c8-8dd9-e72ad8628220 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.557563 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cafce98a-6e30-48c8-8dd9-e72ad8628220 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.557997 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cafce98a-6e30-48c8-8dd9-e72ad8628220 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.559850 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09bef60e-32a3-4e49-991d-53adecf6dcb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.560298 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09bef60e-32a3-4e49-991d-53adecf6dcb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.561066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09bef60e-32a3-4e49-991d-53adecf6dcb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.561499 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09bef60e-32a3-4e49-991d-53adecf6dcb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.582889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cafce98a-6e30-48c8-8dd9-e72ad8628220 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:36:05.587959 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09bef60e-32a3-4e49-991d-53adecf6dcb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:36:05.663634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cafce98a-6e30-48c8-8dd9-e72ad8628220 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 204 len: 0 microversion: 2.1 time: 0.118525 Jul 21 08:36:05.664598 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 372/738] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:36:05 2022] DELETE /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:36:05.671753 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-09bef60e-32a3-4e49-991d-53adecf6dcb6 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 204 len: 0 microversion: 2.1 time: 0.122988 Jul 21 08:36:05.672570 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 367/739] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:36:05 2022] DELETE /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:36:05.674656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-df19be00-545e-4cf7-830e-6df80599b84b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:05.675418 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-df19be00-545e-4cf7-830e-6df80599b84b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:05.680607 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-24fe491f-7088-45bf-be28-809e2ecdad86 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:05.681414 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df19be00-545e-4cf7-830e-6df80599b84b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.681540 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-24fe491f-7088-45bf-be28-809e2ecdad86 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:05.681863 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df19be00-545e-4cf7-830e-6df80599b84b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.682634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df19be00-545e-4cf7-830e-6df80599b84b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.683069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df19be00-545e-4cf7-830e-6df80599b84b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.688146 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fe491f-7088-45bf-be28-809e2ecdad86 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.688146 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fe491f-7088-45bf-be28-809e2ecdad86 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.688544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fe491f-7088-45bf-be28-809e2ecdad86 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:05.688968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fe491f-7088-45bf-be28-809e2ecdad86 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:05.815276 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-df19be00-545e-4cf7-830e-6df80599b84b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:05.820289 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-24fe491f-7088-45bf-be28-809e2ecdad86 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:05.823956 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-df19be00-545e-4cf7-830e-6df80599b84b tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1554 microversion: 2.1 time: 0.154117 Jul 21 08:36:05.825222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 373/740] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:05 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:05.829132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-24fe491f-7088-45bf-be28-809e2ecdad86 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.152535 Jul 21 08:36:05.829704 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 368/741] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:05 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:06.841071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5bb213d2-0b32-428d-9edc-8db0f5ef8606 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:06.841596 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5bb213d2-0b32-428d-9edc-8db0f5ef8606 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:06.846917 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8a4b54ad-e8c5-463d-af4a-15e5a2987f57 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:06.847578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8a4b54ad-e8c5-463d-af4a-15e5a2987f57 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:06.848513 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5bb213d2-0b32-428d-9edc-8db0f5ef8606 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:06.849107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5bb213d2-0b32-428d-9edc-8db0f5ef8606 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:06.849750 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5bb213d2-0b32-428d-9edc-8db0f5ef8606 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:06.850200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5bb213d2-0b32-428d-9edc-8db0f5ef8606 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:06.854127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a4b54ad-e8c5-463d-af4a-15e5a2987f57 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:06.854575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a4b54ad-e8c5-463d-af4a-15e5a2987f57 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:06.855356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a4b54ad-e8c5-463d-af4a-15e5a2987f57 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:06.855798 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a4b54ad-e8c5-463d-af4a-15e5a2987f57 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:06.991222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5bb213d2-0b32-428d-9edc-8db0f5ef8606 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:06.998257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8a4b54ad-e8c5-463d-af4a-15e5a2987f57 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:06.998911 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5bb213d2-0b32-428d-9edc-8db0f5ef8606 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1554 microversion: 2.1 time: 0.161808 Jul 21 08:36:06.999559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 374/742] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:06 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:07.006044 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8a4b54ad-e8c5-463d-af4a-15e5a2987f57 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.163746 Jul 21 08:36:07.007524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 369/743] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:06 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:08.016476 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-55d211f5-cc5d-4bc1-8c8e-0c9738ba87f2 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:08.017107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-55d211f5-cc5d-4bc1-8c8e-0c9738ba87f2 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:08.023702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55d211f5-cc5d-4bc1-8c8e-0c9738ba87f2 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:08.024163 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55d211f5-cc5d-4bc1-8c8e-0c9738ba87f2 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:08.024415 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2abeecf8-3a93-4bd1-bf16-3d7d3a9545cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:08.025425 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55d211f5-cc5d-4bc1-8c8e-0c9738ba87f2 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:08.025529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2abeecf8-3a93-4bd1-bf16-3d7d3a9545cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:08.025868 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55d211f5-cc5d-4bc1-8c8e-0c9738ba87f2 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:08.031579 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2abeecf8-3a93-4bd1-bf16-3d7d3a9545cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:08.032039 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2abeecf8-3a93-4bd1-bf16-3d7d3a9545cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:08.032777 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2abeecf8-3a93-4bd1-bf16-3d7d3a9545cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:08.033206 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2abeecf8-3a93-4bd1-bf16-3d7d3a9545cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:08.160178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-55d211f5-cc5d-4bc1-8c8e-0c9738ba87f2 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:08.161413 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2abeecf8-3a93-4bd1-bf16-3d7d3a9545cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:08.168027 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-55d211f5-cc5d-4bc1-8c8e-0c9738ba87f2 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1554 microversion: 2.1 time: 0.155141 Jul 21 08:36:08.168598 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 375/744] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:08 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:08.168887 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2abeecf8-3a93-4bd1-bf16-3d7d3a9545cb tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.148311 Jul 21 08:36:08.169449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 370/745] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:08 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:09.185777 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6897ab5a-27b9-47dc-be60-563d7fda3414 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:09.186446 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6897ab5a-27b9-47dc-be60-563d7fda3414 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:09.187779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1731c803-686a-449f-8c03-9764b59e8d0a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:09.188442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1731c803-686a-449f-8c03-9764b59e8d0a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:09.193207 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6897ab5a-27b9-47dc-be60-563d7fda3414 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:09.193668 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6897ab5a-27b9-47dc-be60-563d7fda3414 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:09.194448 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6897ab5a-27b9-47dc-be60-563d7fda3414 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:09.194825 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1731c803-686a-449f-8c03-9764b59e8d0a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:09.194957 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6897ab5a-27b9-47dc-be60-563d7fda3414 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:09.195277 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1731c803-686a-449f-8c03-9764b59e8d0a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:09.196080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1731c803-686a-449f-8c03-9764b59e8d0a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:09.197072 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1731c803-686a-449f-8c03-9764b59e8d0a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:09.327874 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6897ab5a-27b9-47dc-be60-563d7fda3414 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:09.331515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1731c803-686a-449f-8c03-9764b59e8d0a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:09.335742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6897ab5a-27b9-47dc-be60-563d7fda3414 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1554 microversion: 2.1 time: 0.153778 Jul 21 08:36:09.336356 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 376/746] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:09 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:09.339233 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1731c803-686a-449f-8c03-9764b59e8d0a tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1521 microversion: 2.1 time: 0.157253 Jul 21 08:36:09.339816 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 371/747] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:09 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:10.049674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-49c69964-13c3-4a51-8c38-4833487a6d2e req-891cd575-b42c-479e-959e-b6f7a11b372a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9611775-7996-4da2-aa8b-5ef9d642cade", "name": "network-vif-deleted", "tag": "2d38ba9b-48d8-48b8-bb69-f7ae8db202d3"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:10.061573 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-49c69964-13c3-4a51-8c38-4833487a6d2e req-891cd575-b42c-479e-959e-b6f7a11b372a service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:10.061878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-49c69964-13c3-4a51-8c38-4833487a6d2e req-891cd575-b42c-479e-959e-b6f7a11b372a service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:10.075434 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-49c69964-13c3-4a51-8c38-4833487a6d2e req-891cd575-b42c-479e-959e-b6f7a11b372a service nova] Creating event network-vif-deleted:2d38ba9b-48d8-48b8-bb69-f7ae8db202d3 for instance e9611775-7996-4da2-aa8b-5ef9d642cade on hv-cinder-85032 Jul 21 08:36:10.083210 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-49c69964-13c3-4a51-8c38-4833487a6d2e req-891cd575-b42c-479e-959e-b6f7a11b372a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036968 Jul 21 08:36:10.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 377/748] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:10.113418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-80aede9e-0466-43a5-813b-4201d9c9d8c0 req-7adc6936-6182-4ce6-8618-ce379953cfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a142cdd4-307c-476e-a178-54914626cda0", "name": "network-vif-deleted", "tag": "6c401b8c-2f91-49c6-acfe-52333748b0c9"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:10.121448 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-80aede9e-0466-43a5-813b-4201d9c9d8c0 req-7adc6936-6182-4ce6-8618-ce379953cfab service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:10.121889 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-80aede9e-0466-43a5-813b-4201d9c9d8c0 req-7adc6936-6182-4ce6-8618-ce379953cfab service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:10.133301 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-80aede9e-0466-43a5-813b-4201d9c9d8c0 req-7adc6936-6182-4ce6-8618-ce379953cfab service nova] Creating event network-vif-deleted:6c401b8c-2f91-49c6-acfe-52333748b0c9 for instance a142cdd4-307c-476e-a178-54914626cda0 on hv-cinder-85032 Jul 21 08:36:10.138248 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-80aede9e-0466-43a5-813b-4201d9c9d8c0 req-7adc6936-6182-4ce6-8618-ce379953cfab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028581 Jul 21 08:36:10.139537 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 372/749] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:10.357521 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:10.358653 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:10.360235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:10.361578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:10.369414 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:10.370128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:10.371713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:10.372430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:10.372578 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:10.373263 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:10.374578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:10.375422 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:10.409806 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:10.410528 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:10.411156 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lazy-loading 'fault' on Instance uuid e9611775-7996-4da2-aa8b-5ef9d642cade {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:36:10.428483 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:10.429251 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:10.430361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lazy-loading 'fault' on Instance uuid a142cdd4-307c-476e-a178-54914626cda0 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:36:10.505196 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8249ebd6b2dc4811ad315d54030d927e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ccb394622d4b24930f8b6396671857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:10.507012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3528104f3e914d62a10e80e13d3c97de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27a1d777abf4d139048716280a4bb4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:10.521192 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad73dc2c-6ae5-4646-9652-895a2f0963f1 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 200 len: 1311 microversion: 2.1 time: 0.168102 Jul 21 08:36:10.521910 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 373/750] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:10 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:10.525064 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cb73a0f1-5348-4bdf-86ec-b555a5334348 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 200 len: 1348 microversion: 2.1 time: 0.174681 Jul 21 08:36:10.526088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 378/751] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:10 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 1348 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:11.538096 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:11.538706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] [instance: a142cdd4-307c-476e-a178-54914626cda0] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:11.540873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:11.542177 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:11.543586 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] [instance: e9611775-7996-4da2-aa8b-5ef9d642cade] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:11.546140 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:11.546576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:11.547356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:11.547786 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:11.550979 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:11.551456 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:11.552245 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:11.552757 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:11.553040 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:11.563563 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] HTTP exception thrown: Instance a142cdd4-307c-476e-a178-54914626cda0 could not be found. Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Request method failure captured: Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 HTTP/1.1 Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6iM3ePdQNOYU9NrpZdSW4k5-tepkW1LXnF6xRNHWXzWwVe2K6dnDtR3dekzKN6kda1f2LJgjvXP36sczxR0S88U2jjKCXvgq3JucN9neKfptczv3FD2wZGwDlmv9_n-KoklrOHHAuEWSWzSa1xT8JTkbN_FOiRQDDENLNKjXqTGOg Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:36:11.565198 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b27a1d777abf4d139048716280a4bb4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: b27a1d777abf4d139048716280a4bb4f Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1929795090 Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 3528104f3e914d62a10e80e13d3c97de Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1929795090-project Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance a142cdd4-307c-476e-a178-54914626cda0 could not be found. Jul 21 08:36:11.566706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'a142cdd4-307c-476e-a178-54914626cda0'} Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a142cdd4-307c-476e-a178-54914626cda0 could not be found. Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:36:11.567789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a142cdd4-307c-476e-a178-54914626cda0 could not be found. Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a142cdd4-307c-476e-a178-54914626cda0 could not be found. Jul 21 08:36:11.568982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.570053 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] Returning 404 to user: Instance a142cdd4-307c-476e-a178-54914626cda0 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:36:11.570053 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5523e47d-c02f-484a-8db5-ab4187776d83 tempest-ServerRescueNegativeTestJSON-1929795090 tempest-ServerRescueNegativeTestJSON-1929795090-project] 10.222.0.47 "GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0" status: 404 len: 111 microversion: 2.1 time: 0.032500 Jul 21 08:36:11.570053 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 374/752] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:11 2022] GET /compute/v2.1/servers/a142cdd4-307c-476e-a178-54914626cda0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:36:11.571386 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] HTTP exception thrown: Instance e9611775-7996-4da2-aa8b-5ef9d642cade could not be found. Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Request method failure captured: Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade HTTP/1.1 Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q9BcTzl3xpftQxHEdw0La7DRejqfH4sXWSiTj510LuNw4vyTmnDTFNOT2rPirAlw_RgjG_oCCvC83jhNwO330fOw9hqUPBMCXjo-akF9rlVbppPj1ZU41deTaOsW9c7tIKAQitRg-A7Z7-4KT7fzss0mxIgQINR2L8DqwjR8apdZms Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: a8ccb394622d4b24930f8b6396671857 Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestMinimumBasicScenario-1843914319 Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:36:11.573312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a8ccb394622d4b24930f8b6396671857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a8ccb394622d4b24930f8b6396671857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a8ccb394622d4b24930f8b6396671857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a8ccb394622d4b24930f8b6396671857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestMinimumBasicScenario-1843914319 Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: a8ccb394622d4b24930f8b6396671857 Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1843914319 Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-TestMinimumBasicScenario-1843914319-project Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 8249ebd6b2dc4811ad315d54030d927e Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestMinimumBasicScenario-1843914319-project Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance e9611775-7996-4da2-aa8b-5ef9d642cade could not be found. Jul 21 08:36:11.578858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'e9611775-7996-4da2-aa8b-5ef9d642cade'} Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9611775-7996-4da2-aa8b-5ef9d642cade could not be found. Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:36:11.580254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9611775-7996-4da2-aa8b-5ef9d642cade could not be found. Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9611775-7996-4da2-aa8b-5ef9d642cade could not be found. Jul 21 08:36:11.582115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:36:11.583315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Returning 404 to user: Instance e9611775-7996-4da2-aa8b-5ef9d642cade could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:36:11.583315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-703aece9-b138-4a41-a8a3-18a73f491ccf tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade" status: 404 len: 111 microversion: 2.1 time: 0.036765 Jul 21 08:36:11.583315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 379/753] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:11 2022] GET /compute/v2.1/servers/e9611775-7996-4da2-aa8b-5ef9d642cade => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:36:11.584496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ecbae8cb-d8f8-40bf-99ad-8708bb9668f5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] Calling method '.version_select at 0x7f65c0d5ac10>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:11.604216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ecbae8cb-d8f8-40bf-99ad-8708bb9668f5 tempest-TestMinimumBasicScenario-1843914319 tempest-TestMinimumBasicScenario-1843914319-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-516647709" status: 202 len: 0 microversion: 2.1 time: 0.023437 Jul 21 08:36:11.605204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 375/754] 10.222.0.47 () {58 vars in 1268 bytes} [Thu Jul 21 08:36:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-516647709 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:36:23.166150 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:23.168183 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:23.308879 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-40a449a8-4532-4e58-a5b9-19114ee323d4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: .version_select at 0x7f65bc30d670>, body: {"keypair": {"name": "tempest-keypair-1639870569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKck60GPE3z55a/w3de7C276ChNiFO4JgCUvZoxSsw8/YTOtFRYeaAzVSRvoFKAsGm0l9GHFDCIIUJuloMXMsHKlEUhiJweeFPorzJBT7xrT6sk+2sMEATjUiRDnGUHvw=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:23.324452 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-40a449a8-4532-4e58-a5b9-19114ee323d4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for project ca704726a8064214b0507190fe51650f. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:36:23.328439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-40a449a8-4532-4e58-a5b9-19114ee323d4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for user 7baa0b2ddca4431b8d006873ca90ab2c and project ca704726a8064214b0507190fe51650f. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:36:23.367960 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-40a449a8-4532-4e58-a5b9-19114ee323d4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206813 Jul 21 08:36:23.368961 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 380/755] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:36:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:24.900408 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1689406007", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84a3c360-33c3-4fe6-9eae-ca3228ce08c7"}], "security_groups": [{"name": "tempest-securitygroup--1230084663"}], "key_name": "tempest-keypair-1639870569", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:24.907459 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:24.908284 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:25.017834 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] validate_networks() for [('84a3c360-33c3-4fe6-9eae-ca3228ce08c7', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:36:25.140346 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dfe69e43-b5f3-4abc-a0df-6ecae5941d98 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:25.142518 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dfe69e43-b5f3-4abc-a0df-6ecae5941d98 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:25.162082 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dfe69e43-b5f3-4abc-a0df-6ecae5941d98 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:25.165185 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dfe69e43-b5f3-4abc-a0df-6ecae5941d98 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:25.168060 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dfe69e43-b5f3-4abc-a0df-6ecae5941d98 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:25.171954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dfe69e43-b5f3-4abc-a0df-6ecae5941d98 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:25.215993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dfe69e43-b5f3-4abc-a0df-6ecae5941d98 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/ips" status: 200 len: 152 microversion: 2.20 time: 0.079669 Jul 21 08:36:25.223916 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 381/756] 10.222.0.47 () {60 vars in 1288 bytes} [Thu Jul 21 08:36:25 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/ips => generated 152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:36:25.596011 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:36:25.596503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:36:25.596985 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:36:25.597394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:36:25.597807 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:36:25.610975 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:25.611473 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:25.612283 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:25.612814 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:25.633612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for project ca704726a8064214b0507190fe51650f. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:36:25.638966 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for user 7baa0b2ddca4431b8d006873ca90ab2c and project ca704726a8064214b0507190fe51650f. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:36:25.652348 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:36:25.654672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:36:25.714620 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d3dc71f0-a0ae-46cc-9823-857dc5b1fb54 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.819427 Jul 21 08:36:25.716104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 376/757] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:36:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:36:25.726622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fe63357a-fca3-4088-a9c6-d955a9e0ea80 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:25.727158 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fe63357a-fca3-4088-a9c6-d955a9e0ea80 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:25.817690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fe63357a-fca3-4088-a9c6-d955a9e0ea80 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:25.828375 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fe63357a-fca3-4088-a9c6-d955a9e0ea80 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1242 microversion: 2.1 time: 0.106058 Jul 21 08:36:25.829000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 382/758] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:25 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:26.855830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-44c634da-49f2-4fee-a56e-9e787131d459 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:26.860506 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-44c634da-49f2-4fee-a56e-9e787131d459 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:26.867924 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44c634da-49f2-4fee-a56e-9e787131d459 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:26.868420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44c634da-49f2-4fee-a56e-9e787131d459 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:26.869440 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44c634da-49f2-4fee-a56e-9e787131d459 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:26.870354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44c634da-49f2-4fee-a56e-9e787131d459 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:26.955368 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-44c634da-49f2-4fee-a56e-9e787131d459 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:26.965191 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-44c634da-49f2-4fee-a56e-9e787131d459 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1312 microversion: 2.1 time: 0.113337 Jul 21 08:36:26.965784 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 377/759] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:26 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:27.360121 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-85cc5882-2d4d-415d-ae8a-1c95c449719f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:27.361985 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-85cc5882-2d4d-415d-ae8a-1c95c449719f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:27.374934 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85cc5882-2d4d-415d-ae8a-1c95c449719f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:27.375787 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85cc5882-2d4d-415d-ae8a-1c95c449719f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:27.377183 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85cc5882-2d4d-415d-ae8a-1c95c449719f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:27.378443 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85cc5882-2d4d-415d-ae8a-1c95c449719f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:27.414125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-85cc5882-2d4d-415d-ae8a-1c95c449719f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lazy-loading 'flavor' on Instance uuid 207a7a3d-14f0-48b6-8ec4-d92b508659d3 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:36:27.737673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-85cc5882-2d4d-415d-ae8a-1c95c449719f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/action" status: 202 len: 0 microversion: 2.20 time: 0.385287 Jul 21 08:36:27.739431 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 383/760] 10.222.0.47 () {62 vars in 1318 bytes} [Thu Jul 21 08:36:27 2022] POST /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:36:27.747558 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:27.748505 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:27.757357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:27.758262 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:27.759885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:27.760373 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:27.936092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:27.944138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:27.945642 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:27.947505 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f28a73d5-c1b6-4008-b00b-ecffccacba1b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.204593 Jul 21 08:36:27.948064 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 378/761] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:27 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:27.982853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d0d5bd88-5a93-4ec0-826c-37381aee9d0a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:27.983685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d0d5bd88-5a93-4ec0-826c-37381aee9d0a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:27.990073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0d5bd88-5a93-4ec0-826c-37381aee9d0a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:27.990533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0d5bd88-5a93-4ec0-826c-37381aee9d0a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:27.991310 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0d5bd88-5a93-4ec0-826c-37381aee9d0a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:27.991775 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0d5bd88-5a93-4ec0-826c-37381aee9d0a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:28.211611 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d0d5bd88-5a93-4ec0-826c-37381aee9d0a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:28.219138 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d0d5bd88-5a93-4ec0-826c-37381aee9d0a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1368 microversion: 2.1 time: 0.240732 Jul 21 08:36:28.219747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 384/762] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:27 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:28.350199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-0de81b54-a11a-4a44-b3b8-3e71eea5bd3f req-e3cc0a3f-6cfc-4854-a46e-3da5d66d4a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9b5c0f-6620-4aaf-bc46-be3c69cd4145", "tag": "56b8d356-6397-47a7-ba19-1dbd4e2f0ee7"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:28.361045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0de81b54-a11a-4a44-b3b8-3e71eea5bd3f req-e3cc0a3f-6cfc-4854-a46e-3da5d66d4a47 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:28.361481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0de81b54-a11a-4a44-b3b8-3e71eea5bd3f req-e3cc0a3f-6cfc-4854-a46e-3da5d66d4a47 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:28.373857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-0de81b54-a11a-4a44-b3b8-3e71eea5bd3f req-e3cc0a3f-6cfc-4854-a46e-3da5d66d4a47 service nova] Creating event network-changed:56b8d356-6397-47a7-ba19-1dbd4e2f0ee7 for instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 on hv-cinder-85032 Jul 21 08:36:28.379584 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-0de81b54-a11a-4a44-b3b8-3e71eea5bd3f req-e3cc0a3f-6cfc-4854-a46e-3da5d66d4a47 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033006 Jul 21 08:36:28.380311 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 379/763] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:28.966343 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:28.966860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:28.973428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:28.973881 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:28.974646 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:28.975086 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:29.107780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:29.115661 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:29.117181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:29.118334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c890846e-f56f-4dca-b5ff-f873fcbcbfb4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.156535 Jul 21 08:36:29.118895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 385/764] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:28 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:29.236758 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ccec6897-77c3-465a-bfb5-7b86582f1555 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:29.237464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ccec6897-77c3-465a-bfb5-7b86582f1555 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:29.243807 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccec6897-77c3-465a-bfb5-7b86582f1555 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:29.244251 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccec6897-77c3-465a-bfb5-7b86582f1555 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:29.245014 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccec6897-77c3-465a-bfb5-7b86582f1555 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:29.245449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccec6897-77c3-465a-bfb5-7b86582f1555 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:29.380827 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ccec6897-77c3-465a-bfb5-7b86582f1555 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:29.388808 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ccec6897-77c3-465a-bfb5-7b86582f1555 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1368 microversion: 2.1 time: 0.156388 Jul 21 08:36:29.389367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 380/765] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:29 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:30.137231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:30.137839 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:30.144260 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:30.144699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:30.145445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:30.145872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:30.277254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:30.285202 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:30.286714 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:30.287919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fcde5765-5d53-40ce-b548-a53667db85cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.155025 Jul 21 08:36:30.288479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 386/766] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:30 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:30.405457 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-394899d3-31e0-46af-bfb9-6f9b7c9f0830 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:30.406096 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-394899d3-31e0-46af-bfb9-6f9b7c9f0830 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:30.412107 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394899d3-31e0-46af-bfb9-6f9b7c9f0830 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:30.412543 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394899d3-31e0-46af-bfb9-6f9b7c9f0830 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:30.413294 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394899d3-31e0-46af-bfb9-6f9b7c9f0830 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:30.413741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394899d3-31e0-46af-bfb9-6f9b7c9f0830 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:30.541148 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-394899d3-31e0-46af-bfb9-6f9b7c9f0830 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:30.548544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-394899d3-31e0-46af-bfb9-6f9b7c9f0830 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1368 microversion: 2.1 time: 0.146947 Jul 21 08:36:30.549111 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 381/767] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:30 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:31.306527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:31.307178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:31.313785 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:31.314233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:31.314994 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:31.315456 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:31.451200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:31.459905 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:31.461412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:31.463233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e022eccb-7423-4c04-a72a-06d3789b3262 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.160623 Jul 21 08:36:31.463830 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 387/768] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:31 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:31.567194 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e351d32d-21c6-4d32-99e3-ecece0fb252a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:31.567980 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e351d32d-21c6-4d32-99e3-ecece0fb252a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:31.574568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e351d32d-21c6-4d32-99e3-ecece0fb252a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:31.575015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e351d32d-21c6-4d32-99e3-ecece0fb252a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:31.575812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e351d32d-21c6-4d32-99e3-ecece0fb252a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:31.576246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e351d32d-21c6-4d32-99e3-ecece0fb252a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:31.709337 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e351d32d-21c6-4d32-99e3-ecece0fb252a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:31.716729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e351d32d-21c6-4d32-99e3-ecece0fb252a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1368 microversion: 2.1 time: 0.154054 Jul 21 08:36:31.717293 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 382/769] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:31 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:32.482122 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:32.482761 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:32.489355 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:32.489802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:32.490569 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:32.491005 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:32.622917 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:32.631417 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:32.632924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:32.634105 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d9fb1419-2275-4ade-9dd2-5e71017f3c75 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.156450 Jul 21 08:36:32.634702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 388/770] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:32 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:32.734336 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c8f80dc-27b3-4668-b5ab-60dfa41e9a1c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:32.734946 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c8f80dc-27b3-4668-b5ab-60dfa41e9a1c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:32.740902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c8f80dc-27b3-4668-b5ab-60dfa41e9a1c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:32.741347 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c8f80dc-27b3-4668-b5ab-60dfa41e9a1c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:32.742108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c8f80dc-27b3-4668-b5ab-60dfa41e9a1c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:32.742541 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c8f80dc-27b3-4668-b5ab-60dfa41e9a1c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:32.878816 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7c8f80dc-27b3-4668-b5ab-60dfa41e9a1c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:32.886851 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c8f80dc-27b3-4668-b5ab-60dfa41e9a1c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1368 microversion: 2.1 time: 0.156337 Jul 21 08:36:32.887485 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 383/771] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:32 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:33.652006 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:33.652621 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:33.659179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:33.659659 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:33.660429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:33.660869 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:33.792369 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:33.800181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:33.801659 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:33.802807 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7d6330ee-2cc6-4746-b901-3038bef46a8b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.154706 Jul 21 08:36:33.803370 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 389/772] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:33 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:33.904124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1676006a-7bc5-44ea-afcf-51831f9fad0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:33.904730 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1676006a-7bc5-44ea-afcf-51831f9fad0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:33.910684 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1676006a-7bc5-44ea-afcf-51831f9fad0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:33.911129 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1676006a-7bc5-44ea-afcf-51831f9fad0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:33.911921 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1676006a-7bc5-44ea-afcf-51831f9fad0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:33.912359 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1676006a-7bc5-44ea-afcf-51831f9fad0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:34.038732 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1676006a-7bc5-44ea-afcf-51831f9fad0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:34.046688 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1676006a-7bc5-44ea-afcf-51831f9fad0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1368 microversion: 2.1 time: 0.146935 Jul 21 08:36:34.047237 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 384/773] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:33 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:34.821313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:34.821941 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:34.828995 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:34.829445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:34.830236 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:34.830639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:34.931837 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-f3022be7-85cf-4041-8496-4eb1b8a21426 req-67b8f170-5116-4327-ae1f-5ce0a306486d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9b5c0f-6620-4aaf-bc46-be3c69cd4145", "name": "network-vif-plugged", "status": "completed", "tag": "56b8d356-6397-47a7-ba19-1dbd4e2f0ee7"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:34.940667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f3022be7-85cf-4041-8496-4eb1b8a21426 req-67b8f170-5116-4327-ae1f-5ce0a306486d service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:34.941101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-f3022be7-85cf-4041-8496-4eb1b8a21426 req-67b8f170-5116-4327-ae1f-5ce0a306486d service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:34.952932 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-f3022be7-85cf-4041-8496-4eb1b8a21426 req-67b8f170-5116-4327-ae1f-5ce0a306486d service nova] Creating event network-vif-plugged:56b8d356-6397-47a7-ba19-1dbd4e2f0ee7 for instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 on hv-cinder-85032 Jul 21 08:36:34.958033 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-f3022be7-85cf-4041-8496-4eb1b8a21426 req-67b8f170-5116-4327-ae1f-5ce0a306486d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097534 Jul 21 08:36:34.958645 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 385/774] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:34.973483 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:34.981721 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:34.983593 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:34.984568 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2be66c3f-7553-4692-92d9-a0f3039db8b1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.167267 Jul 21 08:36:34.985139 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 390/775] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:34 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:35.064424 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74a557fc-c34c-4cf9-a064-fad10072ec48 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:35.065401 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74a557fc-c34c-4cf9-a064-fad10072ec48 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:35.071804 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74a557fc-c34c-4cf9-a064-fad10072ec48 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:35.072199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74a557fc-c34c-4cf9-a064-fad10072ec48 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:35.072964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74a557fc-c34c-4cf9-a064-fad10072ec48 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:35.073390 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74a557fc-c34c-4cf9-a064-fad10072ec48 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:35.211990 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-74a557fc-c34c-4cf9-a064-fad10072ec48 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:35.219467 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74a557fc-c34c-4cf9-a064-fad10072ec48 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1368 microversion: 2.1 time: 0.159623 Jul 21 08:36:35.220034 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 386/776] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:35 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:36.003997 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:36.004745 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:36.007249 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:36.013331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:36.013772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:36.014529 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:36.014957 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:36.144065 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:36.154522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:36.156272 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:36.157703 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-72826f2d-bf6d-45e2-a2cb-3c6dbc559b9c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.158024 Jul 21 08:36:36.164286 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 391/777] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:35 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:36.237130 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27b79d14-2437-4995-852f-fbd03065d1f7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:36.238202 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27b79d14-2437-4995-852f-fbd03065d1f7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:36.240163 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:36.240970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:36.247765 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27b79d14-2437-4995-852f-fbd03065d1f7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:36.248207 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27b79d14-2437-4995-852f-fbd03065d1f7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:36.248970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27b79d14-2437-4995-852f-fbd03065d1f7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:36.249397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27b79d14-2437-4995-852f-fbd03065d1f7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:36.378690 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27b79d14-2437-4995-852f-fbd03065d1f7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:36.386706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27b79d14-2437-4995-852f-fbd03065d1f7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1558 microversion: 2.1 time: 0.153636 Jul 21 08:36:36.387264 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 387/778] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:36 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:36.402795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d7035af3-de17-4c6e-a90e-8ef56ce6399a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:36.403291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d7035af3-de17-4c6e-a90e-8ef56ce6399a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:36.409242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d7035af3-de17-4c6e-a90e-8ef56ce6399a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:36.409703 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d7035af3-de17-4c6e-a90e-8ef56ce6399a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:36.410467 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d7035af3-de17-4c6e-a90e-8ef56ce6399a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:36.410903 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d7035af3-de17-4c6e-a90e-8ef56ce6399a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:36.486794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d7035af3-de17-4c6e-a90e-8ef56ce6399a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087730 Jul 21 08:36:36.487414 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 392/779] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 21 08:36:36 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:37.176427 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:37.177068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:37.183949 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:37.184385 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:37.185169 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:37.185592 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:37.324115 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:37.332105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:37.333617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:37.334798 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d6a15249-9af4-46b0-9577-374dce04d812 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.162437 Jul 21 08:36:37.335398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 388/780] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:37 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:37.419746 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-d26b6f69-d26a-4119-9c6c-e6a173ccdc1e req-83dab936-8892-4a76-b7b7-94462d25a024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9b5c0f-6620-4aaf-bc46-be3c69cd4145", "tag": "56b8d356-6397-47a7-ba19-1dbd4e2f0ee7"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:37.428379 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-d26b6f69-d26a-4119-9c6c-e6a173ccdc1e req-83dab936-8892-4a76-b7b7-94462d25a024 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:37.428846 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-d26b6f69-d26a-4119-9c6c-e6a173ccdc1e req-83dab936-8892-4a76-b7b7-94462d25a024 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:37.442583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-d26b6f69-d26a-4119-9c6c-e6a173ccdc1e req-83dab936-8892-4a76-b7b7-94462d25a024 service nova] Creating event network-changed:56b8d356-6397-47a7-ba19-1dbd4e2f0ee7 for instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 on hv-cinder-85032 Jul 21 08:36:37.448063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-d26b6f69-d26a-4119-9c6c-e6a173ccdc1e req-83dab936-8892-4a76-b7b7-94462d25a024 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033085 Jul 21 08:36:37.448891 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 393/781] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:38.353132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:38.353732 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:38.359806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:38.360239 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:38.360987 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:38.361413 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:38.495467 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:38.504217 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:38.505592 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:38.507085 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b2a440b2-d773-4b60-9564-616701b59dc1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.157836 Jul 21 08:36:38.507594 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 389/782] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:38 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:39.526674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:39.527301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:39.534094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:39.534547 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:39.535312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:39.535774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:39.665252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:39.673674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:39.675191 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:39.676427 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b3fe203c-0394-437d-8494-fc38d17c4286 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.154114 Jul 21 08:36:39.676995 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 394/783] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:39 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:40.695200 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:40.695743 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:40.702359 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:40.702788 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:40.703569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:40.703991 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:40.831344 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:40.839376 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:40.840901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:40.842077 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ab91d4a-3c7b-4b1f-93f9-4399f7fbeb96 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.150831 Jul 21 08:36:40.842640 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 390/784] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:40 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:41.859703 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:41.860261 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:41.866723 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:41.867172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:41.867964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:41.868404 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:42.000903 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:42.009291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:42.011296 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:42.012484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0bba661c-4d5f-4532-92ff-06f6cf38dbd7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.156806 Jul 21 08:36:42.013039 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 395/785] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:41 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:43.031007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:43.031639 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:43.037721 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:43.038166 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:43.038923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:43.039382 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:43.173555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:43.181862 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:43.183372 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:43.184523 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a9df8b6e-fc26-49e4-84e8-fc1eafeacd34 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.157463 Jul 21 08:36:43.185087 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 391/786] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:43 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:44.202000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:44.202646 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:44.209206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:44.209655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:44.210524 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:44.210967 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:44.247885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-730803ed-9a97-42e6-86b0-1949ae523803 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:44.248497 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-730803ed-9a97-42e6-86b0-1949ae523803 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:44.260022 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-730803ed-9a97-42e6-86b0-1949ae523803 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:44.260022 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-730803ed-9a97-42e6-86b0-1949ae523803 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:44.260652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-730803ed-9a97-42e6-86b0-1949ae523803 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:44.261443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-730803ed-9a97-42e6-86b0-1949ae523803 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:44.287419 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-730803ed-9a97-42e6-86b0-1949ae523803 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lazy-loading 'flavor' on Instance uuid 03c09729-8625-497c-b28a-fb99327e229e {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:36:44.346144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:44.349427 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:44.355633 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:44.357179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:44.358364 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-574b1a19-db2e-40ed-9f21-6503e1516abf tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1746 microversion: 2.20 time: 0.160253 Jul 21 08:36:44.359043 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 396/787] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:44 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:44.368477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-730803ed-9a97-42e6-86b0-1949ae523803 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "POST /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e/action" status: 202 len: 0 microversion: 2.1 time: 0.124820 Jul 21 08:36:44.369558 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 392/788] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:36:44 2022] POST /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 08:36:44.381189 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f027e338-5c54-4256-b75c-a804ff79debd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:44.382341 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f027e338-5c54-4256-b75c-a804ff79debd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:44.392068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f027e338-5c54-4256-b75c-a804ff79debd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:44.392899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f027e338-5c54-4256-b75c-a804ff79debd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:44.393700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f027e338-5c54-4256-b75c-a804ff79debd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:44.394143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f027e338-5c54-4256-b75c-a804ff79debd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:44.532176 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f027e338-5c54-4256-b75c-a804ff79debd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:44.535789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:44.540889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f027e338-5c54-4256-b75c-a804ff79debd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.167256 Jul 21 08:36:44.541477 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 397/789] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:44 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:45.378701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:45.379491 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:45.388812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:45.388812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:45.390157 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:45.390885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:45.534019 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:45.542574 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:45.544193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:45.545448 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d8118466-3fd2-4535-8fee-6ed458e97e05 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.171783 Jul 21 08:36:45.546015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 393/790] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:45 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:45.561073 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bc158a2c-340c-4b5f-8837-7e8d259b87f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:45.561691 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bc158a2c-340c-4b5f-8837-7e8d259b87f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:45.569521 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc158a2c-340c-4b5f-8837-7e8d259b87f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:45.569970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc158a2c-340c-4b5f-8837-7e8d259b87f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:45.570730 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc158a2c-340c-4b5f-8837-7e8d259b87f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:45.571165 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc158a2c-340c-4b5f-8837-7e8d259b87f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:45.704693 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bc158a2c-340c-4b5f-8837-7e8d259b87f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:45.712701 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bc158a2c-340c-4b5f-8837-7e8d259b87f7 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.156828 Jul 21 08:36:45.713897 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 398/791] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:45 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:46.564428 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:46.565766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:46.572050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:46.572697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:46.574144 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:46.574733 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:46.724996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:46.733633 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bd58e946-a237-4b88-9c85-f44846fc97a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:46.734962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bd58e946-a237-4b88-9c85-f44846fc97a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:46.738879 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:46.740594 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:46.742887 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd58e946-a237-4b88-9c85-f44846fc97a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:46.743617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd58e946-a237-4b88-9c85-f44846fc97a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:46.744627 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd58e946-a237-4b88-9c85-f44846fc97a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:46.744965 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0dbb781-d2e7-45d0-98ac-5d001ec1a685 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.184339 Jul 21 08:36:46.745290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd58e946-a237-4b88-9c85-f44846fc97a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:46.751377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 394/792] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:46 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:46.888510 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-44c9aa05-5783-44ec-9d92-2343195f4df6 req-6c2cca7b-ad01-4878-abab-c87c21822cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207a7a3d-14f0-48b6-8ec4-d92b508659d3", "name": "network-vif-plugged", "status": "completed", "tag": "5aa7f4fc-7261-46b3-85e6-fd60be720151"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:46.902522 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-44c9aa05-5783-44ec-9d92-2343195f4df6 req-6c2cca7b-ad01-4878-abab-c87c21822cf9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:46.905389 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-44c9aa05-5783-44ec-9d92-2343195f4df6 req-6c2cca7b-ad01-4878-abab-c87c21822cf9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:46.925956 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-44c9aa05-5783-44ec-9d92-2343195f4df6 req-6c2cca7b-ad01-4878-abab-c87c21822cf9 service nova] Creating event network-vif-plugged:5aa7f4fc-7261-46b3-85e6-fd60be720151 for instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 on hv-cinder-85032 Jul 21 08:36:46.932786 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-44c9aa05-5783-44ec-9d92-2343195f4df6 req-6c2cca7b-ad01-4878-abab-c87c21822cf9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047022 Jul 21 08:36:46.934494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 395/793] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:46.944877 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bd58e946-a237-4b88-9c85-f44846fc97a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:46.956138 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bd58e946-a237-4b88-9c85-f44846fc97a6 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.227953 Jul 21 08:36:46.957352 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 399/794] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:46 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:47.767418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:47.768129 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:47.774735 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:47.775468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:47.776525 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:47.776964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:47.919656 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:47.928005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:47.929660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:47.930899 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7db96470-e5a6-4591-b32d-b58f04e9be44 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.168150 Jul 21 08:36:47.942280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 396/795] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:47 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:47.974375 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8c495e69-68e7-48b0-8596-60585fb426c1 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:47.975763 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8c495e69-68e7-48b0-8596-60585fb426c1 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:47.987742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c495e69-68e7-48b0-8596-60585fb426c1 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:47.988188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c495e69-68e7-48b0-8596-60585fb426c1 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:47.989247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c495e69-68e7-48b0-8596-60585fb426c1 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:47.989860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c495e69-68e7-48b0-8596-60585fb426c1 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:48.142801 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8c495e69-68e7-48b0-8596-60585fb426c1 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:48.152406 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8c495e69-68e7-48b0-8596-60585fb426c1 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.182254 Jul 21 08:36:48.153086 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 400/796] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:47 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:48.949801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:48.950412 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:48.956933 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:48.957658 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:48.958492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:48.958989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:49.095896 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:49.104558 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:49.106327 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:49.107546 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-97967e80-4043-48d6-a752-f18520fa5633 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.162285 Jul 21 08:36:49.118036 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 397/797] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:48 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:49.172429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-75f96d3a-564e-4e4a-9ea9-b4014998931b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:49.174323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-75f96d3a-564e-4e4a-9ea9-b4014998931b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:49.180888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f96d3a-564e-4e4a-9ea9-b4014998931b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:49.181331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f96d3a-564e-4e4a-9ea9-b4014998931b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:49.182339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f96d3a-564e-4e4a-9ea9-b4014998931b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:49.182784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f96d3a-564e-4e4a-9ea9-b4014998931b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:49.324720 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-75f96d3a-564e-4e4a-9ea9-b4014998931b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:49.333153 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-75f96d3a-564e-4e4a-9ea9-b4014998931b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.164564 Jul 21 08:36:49.333736 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 401/798] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:49 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:50.129464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:50.130072 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:50.136990 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:50.137650 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:50.138421 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:50.138849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:50.299123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:50.310255 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:50.311786 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:50.312950 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62e848e8-9408-4c57-ad63-a82184f2881a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.188795 Jul 21 08:36:50.324618 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 398/799] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:50 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:50.350018 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e25c8a6a-8fc6-4c61-b674-92377d951556 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:50.350850 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e25c8a6a-8fc6-4c61-b674-92377d951556 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:50.357788 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e25c8a6a-8fc6-4c61-b674-92377d951556 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:50.358238 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e25c8a6a-8fc6-4c61-b674-92377d951556 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:50.359001 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e25c8a6a-8fc6-4c61-b674-92377d951556 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:50.359453 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e25c8a6a-8fc6-4c61-b674-92377d951556 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:50.511239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e25c8a6a-8fc6-4c61-b674-92377d951556 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:50.519398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e25c8a6a-8fc6-4c61-b674-92377d951556 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.173249 Jul 21 08:36:50.528910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 402/800] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:50 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:51.332633 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:51.333180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:51.339402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:51.339852 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:51.340606 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:51.341288 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:51.510605 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:51.519088 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:51.520763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:51.522061 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b04ae4b-f234-4ad2-b909-e9ec87ab34cc tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.193410 Jul 21 08:36:51.522623 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 399/801] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:51 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:51.540254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d81c5846-37c5-4ab9-b8f5-cd78770c2aca tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:51.542160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d81c5846-37c5-4ab9-b8f5-cd78770c2aca tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:51.549233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d81c5846-37c5-4ab9-b8f5-cd78770c2aca tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:51.549932 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d81c5846-37c5-4ab9-b8f5-cd78770c2aca tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:51.550866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d81c5846-37c5-4ab9-b8f5-cd78770c2aca tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:51.551515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d81c5846-37c5-4ab9-b8f5-cd78770c2aca tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:51.709190 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d81c5846-37c5-4ab9-b8f5-cd78770c2aca tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:51.718003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d81c5846-37c5-4ab9-b8f5-cd78770c2aca tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.181644 Jul 21 08:36:51.718580 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 403/802] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:51 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:52.547841 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:52.549632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:52.561065 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:52.561505 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:52.562312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:52.562966 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:52.722298 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:52.731747 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:52.733237 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:52.735482 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-977139af-1806-476a-8992-1652409cd2ac tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:52.736004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-41b13215-19a1-4da1-940f-3d20e8c70e7c tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.191483 Jul 21 08:36:52.736104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-977139af-1806-476a-8992-1652409cd2ac tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:52.742959 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-977139af-1806-476a-8992-1652409cd2ac tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:52.743445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-977139af-1806-476a-8992-1652409cd2ac tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:52.744219 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-977139af-1806-476a-8992-1652409cd2ac tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:52.744696 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-977139af-1806-476a-8992-1652409cd2ac tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:52.747430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 400/803] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:52 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:52.911956 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-977139af-1806-476a-8992-1652409cd2ac tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:52.925376 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-977139af-1806-476a-8992-1652409cd2ac tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.193184 Jul 21 08:36:52.926522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 404/804] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:52 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:53.755069 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:53.757025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:53.763940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:53.764385 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:53.765160 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:53.765622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:53.931802 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:53.941193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:53.941873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ce7383aa-572f-49a7-9451-cba78427dc27 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:53.942485 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ce7383aa-572f-49a7-9451-cba78427dc27 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:53.942994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:53.944169 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-007b22d7-2621-45a9-9e66-c8b41a7f5b62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.193671 Jul 21 08:36:53.944587 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:53.945054 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 401/805] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:53 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:53.950142 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce7383aa-572f-49a7-9451-cba78427dc27 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:53.950585 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce7383aa-572f-49a7-9451-cba78427dc27 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:53.951369 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce7383aa-572f-49a7-9451-cba78427dc27 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:53.952035 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce7383aa-572f-49a7-9451-cba78427dc27 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:54.101302 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ce7383aa-572f-49a7-9451-cba78427dc27 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:54.110067 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ce7383aa-572f-49a7-9451-cba78427dc27 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.171819 Jul 21 08:36:54.110835 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 405/806] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:53 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:36:54.962439 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:54.963027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:54.965593 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:36:54.971294 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:54.971791 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:54.972559 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:54.972989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:55.105801 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:55.113458 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:55.114959 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:55.116476 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8cbc61c5-98c6-4509-a3da-9a19c4cb4ee1 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1741 microversion: 2.20 time: 0.157620 Jul 21 08:36:55.126810 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 402/807] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:54 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:55.127198 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6424debb-439d-48ff-b764-815a08a829fe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:55.127766 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6424debb-439d-48ff-b764-815a08a829fe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:55.134581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6424debb-439d-48ff-b764-815a08a829fe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:55.135039 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6424debb-439d-48ff-b764-815a08a829fe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:55.135887 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6424debb-439d-48ff-b764-815a08a829fe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:55.136328 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6424debb-439d-48ff-b764-815a08a829fe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:55.342651 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6424debb-439d-48ff-b764-815a08a829fe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:55.351064 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6424debb-439d-48ff-b764-815a08a829fe tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.227802 Jul 21 08:36:55.351675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 406/808] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:55 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:56.134230 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:56.134826 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:56.140826 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:56.141268 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:56.142031 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:56.142462 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:56.270234 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:56.278256 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:56.279777 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:56.280917 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-76358ddb-6210-4823-b506-abd9c1469da4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1723 microversion: 2.20 time: 0.150604 Jul 21 08:36:56.281468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 403/809] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:56 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:56.368175 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5530f61c-6e3e-4999-b13e-2108fe29978f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:56.368796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5530f61c-6e3e-4999-b13e-2108fe29978f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:56.375255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5530f61c-6e3e-4999-b13e-2108fe29978f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:56.375740 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5530f61c-6e3e-4999-b13e-2108fe29978f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:56.376506 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5530f61c-6e3e-4999-b13e-2108fe29978f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:56.376944 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5530f61c-6e3e-4999-b13e-2108fe29978f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:56.506780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5530f61c-6e3e-4999-b13e-2108fe29978f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:56.514922 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5530f61c-6e3e-4999-b13e-2108fe29978f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.150599 Jul 21 08:36:56.515515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 407/810] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:56 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:57.299852 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:57.300457 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:57.306615 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:57.307059 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:57.307883 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:57.308259 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:57.440872 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:57.449241 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:57.450748 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:57.451926 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f3ce1a1c-d653-4eee-a2f4-828b918e04e2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1723 microversion: 2.20 time: 0.156033 Jul 21 08:36:57.452484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 404/811] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:57 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:57.532697 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0217226f-2412-4e86-87f8-01d1acae6b47 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:57.533235 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0217226f-2412-4e86-87f8-01d1acae6b47 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:57.539736 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0217226f-2412-4e86-87f8-01d1acae6b47 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:57.540179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0217226f-2412-4e86-87f8-01d1acae6b47 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:57.540934 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0217226f-2412-4e86-87f8-01d1acae6b47 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:57.541360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0217226f-2412-4e86-87f8-01d1acae6b47 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:57.670615 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0217226f-2412-4e86-87f8-01d1acae6b47 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:57.678210 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0217226f-2412-4e86-87f8-01d1acae6b47 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.149427 Jul 21 08:36:57.678778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 408/812] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:57 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:58.469896 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:58.470499 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:58.476628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:58.477079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:58.478009 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:58.478261 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:58.623872 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:58.632329 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:58.633819 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:58.634996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fdaafe5f-eb0b-4b6e-90cc-4e6602b50706 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1723 microversion: 2.20 time: 0.169086 Jul 21 08:36:58.635591 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 405/813] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:58 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:58.695185 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6a19767a-5fa5-440b-8955-09feb9903c57 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:58.695868 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6a19767a-5fa5-440b-8955-09feb9903c57 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:58.702545 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a19767a-5fa5-440b-8955-09feb9903c57 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:58.703071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a19767a-5fa5-440b-8955-09feb9903c57 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:58.703884 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a19767a-5fa5-440b-8955-09feb9903c57 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:58.704322 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a19767a-5fa5-440b-8955-09feb9903c57 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:58.848684 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6a19767a-5fa5-440b-8955-09feb9903c57 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:58.857424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6a19767a-5fa5-440b-8955-09feb9903c57 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.166066 Jul 21 08:36:58.858105 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 409/814] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:58 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:36:58.865601 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-b144c890-1aaa-4b25-8bfb-acf9c91a710a req-5427a6ee-9438-4098-ace9-907539e74d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207a7a3d-14f0-48b6-8ec4-d92b508659d3", "name": "network-vif-unplugged", "status": "completed", "tag": "5aa7f4fc-7261-46b3-85e6-fd60be720151"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:58.874342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-b144c890-1aaa-4b25-8bfb-acf9c91a710a req-5427a6ee-9438-4098-ace9-907539e74d29 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:58.875407 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-b144c890-1aaa-4b25-8bfb-acf9c91a710a req-5427a6ee-9438-4098-ace9-907539e74d29 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:58.886699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-b144c890-1aaa-4b25-8bfb-acf9c91a710a req-5427a6ee-9438-4098-ace9-907539e74d29 service nova] Creating event network-vif-unplugged:5aa7f4fc-7261-46b3-85e6-fd60be720151 for instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 on hv-cinder-85032 Jul 21 08:36:58.891927 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-b144c890-1aaa-4b25-8bfb-acf9c91a710a req-5427a6ee-9438-4098-ace9-907539e74d29 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030538 Jul 21 08:36:58.892778 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 406/815] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:36:59.653104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:59.653719 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:59.659718 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:59.660172 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:59.660926 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:59.661359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:59.795089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:59.803092 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:59.804635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:36:59.805796 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3e38995b-46ab-4098-b2d8-3f779da10380 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1666 microversion: 2.20 time: 0.156612 Jul 21 08:36:59.806359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 410/816] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:36:59 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:36:59.824314 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f04c4fd-cd1c-4400-94c4-17d4ab0b9c1e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5cb5b12-2fc1-4bbf-b1a2-d2f2e9677b08"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:36:59.825455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2f04c4fd-cd1c-4400-94c4-17d4ab0b9c1e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:59.831701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f04c4fd-cd1c-4400-94c4-17d4ab0b9c1e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:59.832151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f04c4fd-cd1c-4400-94c4-17d4ab0b9c1e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:59.832911 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f04c4fd-cd1c-4400-94c4-17d4ab0b9c1e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:59.833342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f04c4fd-cd1c-4400-94c4-17d4ab0b9c1e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:59.874473 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2d531acc-30e0-47ab-8626-e6533db3ade2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:36:59.875256 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2d531acc-30e0-47ab-8626-e6533db3ade2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:36:59.881978 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2d531acc-30e0-47ab-8626-e6533db3ade2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:59.882434 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2d531acc-30e0-47ab-8626-e6533db3ade2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:36:59.883449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2d531acc-30e0-47ab-8626-e6533db3ade2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:36:59.883735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2d531acc-30e0-47ab-8626-e6533db3ade2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.025517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2d531acc-30e0-47ab-8626-e6533db3ade2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:00.033848 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2d531acc-30e0-47ab-8626-e6533db3ade2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1509 microversion: 2.1 time: 0.163859 Jul 21 08:37:00.034418 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 411/817] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:36:59 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:37:00.057052 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fb959c80-40e5-43fd-98f3-efa18cafb6d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:00.057648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fb959c80-40e5-43fd-98f3-efa18cafb6d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:00.066327 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fb959c80-40e5-43fd-98f3-efa18cafb6d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.066910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fb959c80-40e5-43fd-98f3-efa18cafb6d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.068132 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fb959c80-40e5-43fd-98f3-efa18cafb6d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.068578 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fb959c80-40e5-43fd-98f3-efa18cafb6d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.129849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:00.136047 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f04c4fd-cd1c-4400-94c4-17d4ab0b9c1e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316105 Jul 21 08:37:00.139497 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 407/818] 10.222.0.47 () {62 vars in 1363 bytes} [Thu Jul 21 08:36:59 2022] POST /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 08:37:00.254748 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-39fbda25-4aee-4de7-bdcb-24140157a954 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:00.255239 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-39fbda25-4aee-4de7-bdcb-24140157a954 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:00.258430 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fb959c80-40e5-43fd-98f3-efa18cafb6d0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "POST /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e/action" status: 202 len: 0 microversion: 2.1 time: 0.210934 Jul 21 08:37:00.262781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 412/819] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:37:00 2022] POST /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 08:37:00.263176 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39fbda25-4aee-4de7-bdcb-24140157a954 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.263909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39fbda25-4aee-4de7-bdcb-24140157a954 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.264697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39fbda25-4aee-4de7-bdcb-24140157a954 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.265122 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39fbda25-4aee-4de7-bdcb-24140157a954 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.269850 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-410563e6-888f-429b-a0bf-2ff6f8fea61a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:00.271777 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-410563e6-888f-429b-a0bf-2ff6f8fea61a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:00.278495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-410563e6-888f-429b-a0bf-2ff6f8fea61a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.278945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-410563e6-888f-429b-a0bf-2ff6f8fea61a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.279992 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-410563e6-888f-429b-a0bf-2ff6f8fea61a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.280448 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-410563e6-888f-429b-a0bf-2ff6f8fea61a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.300101 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:00.460308 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-410563e6-888f-429b-a0bf-2ff6f8fea61a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:00.469001 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-410563e6-888f-429b-a0bf-2ff6f8fea61a tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1517 microversion: 2.1 time: 0.204771 Jul 21 08:37:00.469987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 413/820] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:00 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:00.545402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-39fbda25-4aee-4de7-bdcb-24140157a954 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "DELETE /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/os-volume_attachments/b5cb5b12-2fc1-4bbf-b1a2-d2f2e9677b08" status: 202 len: 0 microversion: 2.20 time: 0.295195 Jul 21 08:37:00.545991 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 408/821] 10.222.0.47 () {60 vars in 1456 bytes} [Thu Jul 21 08:37:00 2022] DELETE /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/os-volume_attachments/b5cb5b12-2fc1-4bbf-b1a2-d2f2e9677b08 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:37:00.604318 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1299f856-eb89-497b-bcbb-3faa398b39da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:00.605402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1299f856-eb89-497b-bcbb-3faa398b39da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:00.611639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1299f856-eb89-497b-bcbb-3faa398b39da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.612098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1299f856-eb89-497b-bcbb-3faa398b39da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.612871 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1299f856-eb89-497b-bcbb-3faa398b39da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.613309 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1299f856-eb89-497b-bcbb-3faa398b39da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.694542 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1299f856-eb89-497b-bcbb-3faa398b39da tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "POST /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/action" status: 202 len: 0 microversion: 2.20 time: 0.093965 Jul 21 08:37:00.695020 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 414/822] 10.222.0.47 () {62 vars in 1318 bytes} [Thu Jul 21 08:37:00 2022] POST /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:37:00.703626 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:00.704373 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:00.711388 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.711906 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.712780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.713271 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.913631 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:00.915618 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-bc926630-9b58-43b0-b860-4fdcfe907d6d req-22c5cfb2-b00a-471c-898a-aa4becbc5b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c09729-8625-497c-b28a-fb99327e229e", "name": "network-vif-unplugged", "status": "completed", "tag": "4a25ac86-dd7b-49f3-a64b-cc34f393a6a4"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:00.923748 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:00.926358 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:00.927763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-41cdbab7-9497-4c49-a49b-2a2fcd0b007a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1674 microversion: 2.20 time: 0.228466 Jul 21 08:37:00.928957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 409/823] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:00 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1674 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:00.930003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-bc926630-9b58-43b0-b860-4fdcfe907d6d req-22c5cfb2-b00a-471c-898a-aa4becbc5b57 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:00.930643 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-bc926630-9b58-43b0-b860-4fdcfe907d6d req-22c5cfb2-b00a-471c-898a-aa4becbc5b57 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:00.942279 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.compute.server_external_events [req-bc926630-9b58-43b0-b860-4fdcfe907d6d req-22c5cfb2-b00a-471c-898a-aa4becbc5b57 service nova] Unable to find a host for instance 03c09729-8625-497c-b28a-fb99327e229e. Dropping event network-vif-unplugged {{(pid=117950) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 08:37:00.943181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-bc926630-9b58-43b0-b860-4fdcfe907d6d req-22c5cfb2-b00a-471c-898a-aa4becbc5b57 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031819 Jul 21 08:37:00.943863 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 415/824] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 21 08:37:01.486038 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bcfb263f-eb3f-4b34-b732-e680cb25c4a0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:01.486680 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bcfb263f-eb3f-4b34-b732-e680cb25c4a0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:01.493237 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcfb263f-eb3f-4b34-b732-e680cb25c4a0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:01.493670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcfb263f-eb3f-4b34-b732-e680cb25c4a0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:01.494449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcfb263f-eb3f-4b34-b732-e680cb25c4a0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:01.494905 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcfb263f-eb3f-4b34-b732-e680cb25c4a0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:01.629327 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bcfb263f-eb3f-4b34-b732-e680cb25c4a0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:01.637481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bcfb263f-eb3f-4b34-b732-e680cb25c4a0 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1519 microversion: 2.1 time: 0.155347 Jul 21 08:37:01.638042 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 410/825] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:01 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:01.946028 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:01.946642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:01.953903 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:01.954341 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:01.955341 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:01.955790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:02.089745 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:02.097700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:02.099192 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:02.100382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b08c2e72-b109-43bd-afea-b3c9c344da2e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.158274 Jul 21 08:37:02.100936 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 416/826] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:01 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:02.654351 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ae90463-4624-465d-b1ae-c8c70f5998b5 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:02.654983 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ae90463-4624-465d-b1ae-c8c70f5998b5 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:02.661296 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ae90463-4624-465d-b1ae-c8c70f5998b5 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:02.661751 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ae90463-4624-465d-b1ae-c8c70f5998b5 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:02.662621 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ae90463-4624-465d-b1ae-c8c70f5998b5 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:02.663064 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ae90463-4624-465d-b1ae-c8c70f5998b5 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:02.835091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ae90463-4624-465d-b1ae-c8c70f5998b5 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:02.846478 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ae90463-4624-465d-b1ae-c8c70f5998b5 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.195996 Jul 21 08:37:02.859931 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 411/827] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:02 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:03.119304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:03.120014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:03.127057 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:03.127057 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:03.127838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:03.128533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:03.285889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:03.294839 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:03.296364 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:03.297543 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f065072f-8320-4f4b-aa76-faeb9b9ddafd tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.182214 Jul 21 08:37:03.298105 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 417/828] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:03 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:03.866180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-adac4311-56e9-4446-868b-99b54a271bf8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:03.866761 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-adac4311-56e9-4446-868b-99b54a271bf8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:03.873632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adac4311-56e9-4446-868b-99b54a271bf8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:03.874075 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adac4311-56e9-4446-868b-99b54a271bf8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:03.874852 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adac4311-56e9-4446-868b-99b54a271bf8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:03.875444 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-adac4311-56e9-4446-868b-99b54a271bf8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:04.015056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-adac4311-56e9-4446-868b-99b54a271bf8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:04.023403 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-adac4311-56e9-4446-868b-99b54a271bf8 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.161081 Jul 21 08:37:04.034515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 412/829] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:03 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:04.320716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:04.321713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:04.333515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:04.334325 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:04.335985 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:04.336783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:04.477810 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:04.486367 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:04.487995 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:04.489072 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6315b073-7fc7-4afe-a3c9-8a9d020260b4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.175128 Jul 21 08:37:04.489636 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 418/830] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:04 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:05.042923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66d088b3-b3ba-4360-a23c-92cfd8e81b0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:05.044087 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66d088b3-b3ba-4360-a23c-92cfd8e81b0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:05.050512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66d088b3-b3ba-4360-a23c-92cfd8e81b0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:05.051577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66d088b3-b3ba-4360-a23c-92cfd8e81b0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:05.052356 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66d088b3-b3ba-4360-a23c-92cfd8e81b0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:05.052789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66d088b3-b3ba-4360-a23c-92cfd8e81b0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:05.198246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66d088b3-b3ba-4360-a23c-92cfd8e81b0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:05.205847 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66d088b3-b3ba-4360-a23c-92cfd8e81b0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.167563 Jul 21 08:37:05.206413 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 413/831] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:05 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:05.507621 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:05.508326 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:05.515070 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:05.515548 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:05.516336 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:05.516776 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:05.670798 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:05.679231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:05.681134 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:05.682674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0efdff56-dbfe-49e9-97b3-f4c7b5f9bb4b tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.178662 Jul 21 08:37:05.683386 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 419/832] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:05 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:06.222202 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9d66c49a-4546-494d-8a74-fe35880c363f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:06.222829 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9d66c49a-4546-494d-8a74-fe35880c363f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:06.229080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d66c49a-4546-494d-8a74-fe35880c363f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:06.229583 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d66c49a-4546-494d-8a74-fe35880c363f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:06.230565 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d66c49a-4546-494d-8a74-fe35880c363f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:06.231008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d66c49a-4546-494d-8a74-fe35880c363f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:06.372123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9d66c49a-4546-494d-8a74-fe35880c363f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:06.380079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9d66c49a-4546-494d-8a74-fe35880c363f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.161691 Jul 21 08:37:06.390383 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 414/833] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:06 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:06.700981 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:06.701725 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:06.708613 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:06.709060 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:06.709843 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:06.710280 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:06.857601 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:06.866309 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:06.868028 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:06.869201 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-21b61815-6961-467a-8716-d9af7741d676 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.172253 Jul 21 08:37:06.869955 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 420/834] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:06 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:07.400010 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b8809dc6-0c40-4e3d-bfa1-45a8be10fb36 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:07.401060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b8809dc6-0c40-4e3d-bfa1-45a8be10fb36 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:07.408354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8809dc6-0c40-4e3d-bfa1-45a8be10fb36 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:07.408803 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8809dc6-0c40-4e3d-bfa1-45a8be10fb36 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:07.409574 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8809dc6-0c40-4e3d-bfa1-45a8be10fb36 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:07.410007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8809dc6-0c40-4e3d-bfa1-45a8be10fb36 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:07.557663 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b8809dc6-0c40-4e3d-bfa1-45a8be10fb36 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:07.567882 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b8809dc6-0c40-4e3d-bfa1-45a8be10fb36 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.173217 Jul 21 08:37:07.568684 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 415/835] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:07 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:07.888889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:07.889479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:07.896398 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:07.896844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:07.897638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:07.898502 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:08.045501 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:08.053638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:08.055144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:08.056368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b6b90840-06c3-467f-b38a-703563727086 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.172324 Jul 21 08:37:08.059461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 421/836] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:07 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:08.585561 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-61e84c4a-f269-4423-9f37-63793c6282af tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:08.586163 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-61e84c4a-f269-4423-9f37-63793c6282af tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:08.592932 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61e84c4a-f269-4423-9f37-63793c6282af tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:08.593381 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61e84c4a-f269-4423-9f37-63793c6282af tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:08.594147 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61e84c4a-f269-4423-9f37-63793c6282af tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:08.594578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-61e84c4a-f269-4423-9f37-63793c6282af tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:08.734266 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-61e84c4a-f269-4423-9f37-63793c6282af tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:08.742053 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-61e84c4a-f269-4423-9f37-63793c6282af tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.160285 Jul 21 08:37:08.742574 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 416/837] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:08 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:09.077870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:09.078818 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:09.085170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:09.085617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:09.086386 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:09.086826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:09.233003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:09.241560 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:09.243075 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:09.244290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-57f2c953-bec5-4f00-9113-4ad6099bd8f2 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.171221 Jul 21 08:37:09.244854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 422/838] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:09 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:09.759554 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9465b1db-2ad2-4021-a8cb-c7ec4d148bf2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:09.760264 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9465b1db-2ad2-4021-a8cb-c7ec4d148bf2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:09.767377 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9465b1db-2ad2-4021-a8cb-c7ec4d148bf2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:09.768129 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9465b1db-2ad2-4021-a8cb-c7ec4d148bf2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:09.769119 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9465b1db-2ad2-4021-a8cb-c7ec4d148bf2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:09.769758 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9465b1db-2ad2-4021-a8cb-c7ec4d148bf2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:09.921856 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9465b1db-2ad2-4021-a8cb-c7ec4d148bf2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:09.929688 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9465b1db-2ad2-4021-a8cb-c7ec4d148bf2 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.173963 Jul 21 08:37:09.940101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 417/839] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:09 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:10.265155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:10.265904 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:10.277365 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:10.278221 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:10.279491 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:10.280638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:10.449341 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:10.458429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:10.460024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:10.461222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-021a77cb-ee4c-4610-bc27-c3908f6c7275 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.202647 Jul 21 08:37:10.462456 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 423/840] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:10 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:10.947719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-088a93eb-d327-42a0-b8e3-28ecfd2f7840 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:10.949746 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-088a93eb-d327-42a0-b8e3-28ecfd2f7840 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:10.956325 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088a93eb-d327-42a0-b8e3-28ecfd2f7840 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:10.957102 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088a93eb-d327-42a0-b8e3-28ecfd2f7840 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:10.958096 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088a93eb-d327-42a0-b8e3-28ecfd2f7840 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:10.958746 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088a93eb-d327-42a0-b8e3-28ecfd2f7840 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:11.134974 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-088a93eb-d327-42a0-b8e3-28ecfd2f7840 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:11.143256 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-088a93eb-d327-42a0-b8e3-28ecfd2f7840 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.199321 Jul 21 08:37:11.143870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 418/841] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:10 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:11.479421 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:11.479944 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:11.486663 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:11.487120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:11.488148 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:11.488461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:11.622265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:11.630518 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:11.632045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:11.633208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fede4299-c76e-4613-a440-01d110abbfb6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.157851 Jul 21 08:37:11.633775 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 424/842] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:11 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:12.161891 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8a99c416-042e-4d41-9de0-8650f33eb9ff tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:12.162503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8a99c416-042e-4d41-9de0-8650f33eb9ff tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:12.168538 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a99c416-042e-4d41-9de0-8650f33eb9ff tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:12.168992 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a99c416-042e-4d41-9de0-8650f33eb9ff tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:12.169749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a99c416-042e-4d41-9de0-8650f33eb9ff tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:12.170179 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a99c416-042e-4d41-9de0-8650f33eb9ff tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:12.299046 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8a99c416-042e-4d41-9de0-8650f33eb9ff tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:12.306579 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8a99c416-042e-4d41-9de0-8650f33eb9ff tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.148491 Jul 21 08:37:12.307145 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 419/843] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:12 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:37:12.651896 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:12.652505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:12.659166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:12.659648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:12.660412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:12.660854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:12.788995 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:12.797644 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:12.799137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:12.800394 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-430d0ffa-26d6-4aa5-80ee-b8db398864c6 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.152384 Jul 21 08:37:12.800949 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 425/844] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:12 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:37:13.324541 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-43541ad5-75b3-4ba4-b676-9f075ed0f996 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:13.325144 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-43541ad5-75b3-4ba4-b676-9f075ed0f996 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:13.331185 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43541ad5-75b3-4ba4-b676-9f075ed0f996 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:13.331653 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43541ad5-75b3-4ba4-b676-9f075ed0f996 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:13.332414 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43541ad5-75b3-4ba4-b676-9f075ed0f996 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:13.332834 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-43541ad5-75b3-4ba4-b676-9f075ed0f996 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:13.462972 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-43541ad5-75b3-4ba4-b676-9f075ed0f996 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:13.471028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-43541ad5-75b3-4ba4-b676-9f075ed0f996 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.150845 Jul 21 08:37:13.471623 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 420/845] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:13 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:13.565162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-daacf613-9fbc-4b83-8073-c3b5fca09f27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:13.565590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-daacf613-9fbc-4b83-8073-c3b5fca09f27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:13.571670 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-daacf613-9fbc-4b83-8073-c3b5fca09f27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:13.572132 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-daacf613-9fbc-4b83-8073-c3b5fca09f27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:13.572893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-daacf613-9fbc-4b83-8073-c3b5fca09f27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:13.573982 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-daacf613-9fbc-4b83-8073-c3b5fca09f27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:13.596350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-daacf613-9fbc-4b83-8073-c3b5fca09f27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/ips" status: 200 len: 150 microversion: 2.1 time: 0.035069 Jul 21 08:37:13.596930 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 426/846] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:37:13 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:37:13.819387 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:13.819929 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:13.826782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:13.827098 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:13.828095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:13.828529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:13.965023 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:13.972943 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:13.974440 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:13.975607 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-902154c1-89c5-476f-bfbf-4a8de1682056 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.160366 Jul 21 08:37:13.976165 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 421/847] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:13 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:14.488340 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-69456762-7d75-4d4a-8557-b39496c6021b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:14.488964 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-69456762-7d75-4d4a-8557-b39496c6021b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:14.495599 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-69456762-7d75-4d4a-8557-b39496c6021b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:14.496028 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-69456762-7d75-4d4a-8557-b39496c6021b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:14.496794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-69456762-7d75-4d4a-8557-b39496c6021b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:14.497228 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-69456762-7d75-4d4a-8557-b39496c6021b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:14.627496 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-69456762-7d75-4d4a-8557-b39496c6021b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:14.635147 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-69456762-7d75-4d4a-8557-b39496c6021b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.150702 Jul 21 08:37:14.635774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 427/848] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:14 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:14.952902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-076df26a-a7aa-4d59-9bc0-eedaffcfba57 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:14.954016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-076df26a-a7aa-4d59-9bc0-eedaffcfba57 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:14.960066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-076df26a-a7aa-4d59-9bc0-eedaffcfba57 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:14.960499 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-076df26a-a7aa-4d59-9bc0-eedaffcfba57 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:14.961244 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-076df26a-a7aa-4d59-9bc0-eedaffcfba57 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:14.961664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-076df26a-a7aa-4d59-9bc0-eedaffcfba57 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:14.965865 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:14.996694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:14.997309 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:15.003880 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:15.004571 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:15.005345 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:15.005772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:15.146648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:15.160952 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:15.162010 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:15.163573 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-434f5b99-f7d2-43e3-b4bc-b7b3e94cca60 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.173450 Jul 21 08:37:15.164184 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 428/849] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:14 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 08:37:15.242427 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-076df26a-a7aa-4d59-9bc0-eedaffcfba57 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293756 Jul 21 08:37:15.243482 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 422/850] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:37:14 2022] POST /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:37:15.652419 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91199d47-7195-407d-b44a-73e93f789d01 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:15.653075 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-91199d47-7195-407d-b44a-73e93f789d01 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:15.659650 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91199d47-7195-407d-b44a-73e93f789d01 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:15.660092 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91199d47-7195-407d-b44a-73e93f789d01 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:15.660858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91199d47-7195-407d-b44a-73e93f789d01 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:15.661285 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91199d47-7195-407d-b44a-73e93f789d01 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:15.799792 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-91199d47-7195-407d-b44a-73e93f789d01 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:15.807314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-91199d47-7195-407d-b44a-73e93f789d01 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.158769 Jul 21 08:37:15.808464 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 429/851] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:15 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:16.181738 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:16.182470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:16.189202 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:16.189640 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:16.190382 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:16.190834 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:16.329028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:16.336971 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:16.338459 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:16.339622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b44e10e-e309-4a82-8ad2-0990aa8942cb tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.162177 Jul 21 08:37:16.340274 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 423/852] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:16 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:16.825538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b52e53eb-db98-4863-974f-91dcce155063 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:16.826157 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b52e53eb-db98-4863-974f-91dcce155063 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:16.832904 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b52e53eb-db98-4863-974f-91dcce155063 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:16.833350 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b52e53eb-db98-4863-974f-91dcce155063 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:16.834104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b52e53eb-db98-4863-974f-91dcce155063 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:16.834532 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b52e53eb-db98-4863-974f-91dcce155063 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:16.838487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:16.979175 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b52e53eb-db98-4863-974f-91dcce155063 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:16.987772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b52e53eb-db98-4863-974f-91dcce155063 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.166633 Jul 21 08:37:16.988612 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 430/853] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:16 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:17.141291 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-0184fbf4-bbd6-4323-b862-979825ae0b2c req-bab864f2-7d15-42f7-b216-16f0e5d1017d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207a7a3d-14f0-48b6-8ec4-d92b508659d3", "name": "network-vif-plugged", "status": "completed", "tag": "5aa7f4fc-7261-46b3-85e6-fd60be720151"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:17.150133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0184fbf4-bbd6-4323-b862-979825ae0b2c req-bab864f2-7d15-42f7-b216-16f0e5d1017d service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:17.150669 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0184fbf4-bbd6-4323-b862-979825ae0b2c req-bab864f2-7d15-42f7-b216-16f0e5d1017d service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:17.161642 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-0184fbf4-bbd6-4323-b862-979825ae0b2c req-bab864f2-7d15-42f7-b216-16f0e5d1017d service nova] Creating event network-vif-plugged:5aa7f4fc-7261-46b3-85e6-fd60be720151 for instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 on hv-cinder-85032 Jul 21 08:37:17.166326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-0184fbf4-bbd6-4323-b862-979825ae0b2c req-bab864f2-7d15-42f7-b216-16f0e5d1017d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028685 Jul 21 08:37:17.167170 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 424/854] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:37:17.358651 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:17.359186 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:17.365189 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:17.365632 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:17.366390 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:17.366819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:17.496948 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:17.505515 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:17.507009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:17.508219 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1e7f4ecb-58f9-475d-9112-739973d2a785 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.154151 Jul 21 08:37:17.508783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 431/855] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:17 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:18.006912 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63e10808-2df5-4bec-9343-2624e1ebcb45 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:18.007544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-63e10808-2df5-4bec-9343-2624e1ebcb45 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:18.014082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e10808-2df5-4bec-9343-2624e1ebcb45 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:18.014533 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e10808-2df5-4bec-9343-2624e1ebcb45 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:18.015370 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e10808-2df5-4bec-9343-2624e1ebcb45 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:18.015810 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e10808-2df5-4bec-9343-2624e1ebcb45 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:18.147318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-63e10808-2df5-4bec-9343-2624e1ebcb45 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:18.155394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-63e10808-2df5-4bec-9343-2624e1ebcb45 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.153512 Jul 21 08:37:18.155964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 425/856] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:18 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:18.526757 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:18.527382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:18.535194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:18.535662 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:18.536425 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:18.536853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:18.671743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:18.679511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:18.681022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:18.682167 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ac0d504a-659d-44db-9530-b9604d96c2e4 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.159369 Jul 21 08:37:18.682725 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 432/857] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:18 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:19.173328 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-432b82d0-eda5-4fe0-a057-64f5db8f7d95 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:19.173941 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-432b82d0-eda5-4fe0-a057-64f5db8f7d95 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:19.180455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-432b82d0-eda5-4fe0-a057-64f5db8f7d95 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:19.180904 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-432b82d0-eda5-4fe0-a057-64f5db8f7d95 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:19.181662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-432b82d0-eda5-4fe0-a057-64f5db8f7d95 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:19.182092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-432b82d0-eda5-4fe0-a057-64f5db8f7d95 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:19.317045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-432b82d0-eda5-4fe0-a057-64f5db8f7d95 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:19.325422 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-432b82d0-eda5-4fe0-a057-64f5db8f7d95 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.156857 Jul 21 08:37:19.326099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 426/858] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:19 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:19.700114 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:19.701410 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:19.709947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:19.710851 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:19.711925 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:19.712581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:19.879294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:19.888278 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:19.889874 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:19.891301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b85ce021-d8e3-458a-8781-03ac6e8a627a tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1732 microversion: 2.20 time: 0.195555 Jul 21 08:37:19.891889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 433/859] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:19 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:20.342208 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3ecba0d-40ff-4fd4-b0fd-d7d641095e43 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:20.342727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3ecba0d-40ff-4fd4-b0fd-d7d641095e43 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:20.349096 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3ecba0d-40ff-4fd4-b0fd-d7d641095e43 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:20.349600 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3ecba0d-40ff-4fd4-b0fd-d7d641095e43 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:20.350282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3ecba0d-40ff-4fd4-b0fd-d7d641095e43 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:20.350708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3ecba0d-40ff-4fd4-b0fd-d7d641095e43 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:20.483917 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e3ecba0d-40ff-4fd4-b0fd-d7d641095e43 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:20.491509 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3ecba0d-40ff-4fd4-b0fd-d7d641095e43 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.153193 Jul 21 08:37:20.492085 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 427/860] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:20 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:20.910345 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:20.911102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:20.917777 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:20.918161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:20.919492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:20.919932 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:21.034452 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-017aa582-7865-49f8-8552-fee42cdd15a6 req-94dd636c-359a-45cb-941b-34241b2dfbfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c09729-8625-497c-b28a-fb99327e229e", "name": "network-vif-plugged", "status": "completed", "tag": "4a25ac86-dd7b-49f3-a64b-cc34f393a6a4"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:21.042732 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-017aa582-7865-49f8-8552-fee42cdd15a6 req-94dd636c-359a-45cb-941b-34241b2dfbfa service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:21.043189 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-017aa582-7865-49f8-8552-fee42cdd15a6 req-94dd636c-359a-45cb-941b-34241b2dfbfa service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:21.056208 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:21.057200 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-017aa582-7865-49f8-8552-fee42cdd15a6 req-94dd636c-359a-45cb-941b-34241b2dfbfa service nova] Creating event network-vif-plugged:4a25ac86-dd7b-49f3-a64b-cc34f393a6a4 for instance 03c09729-8625-497c-b28a-fb99327e229e on hv-cinder-85032 Jul 21 08:37:21.062235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-017aa582-7865-49f8-8552-fee42cdd15a6 req-94dd636c-359a-45cb-941b-34241b2dfbfa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031401 Jul 21 08:37:21.062835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 428/861] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:37:21.065990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:21.067739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:21.069128 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-74eb1f8d-10f3-42ea-9076-6c0f8694a723 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1719 microversion: 2.20 time: 0.162672 Jul 21 08:37:21.069834 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 434/862] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:20 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:37:21.509930 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8a9483c7-102d-4141-92e7-440ac6523f0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:21.511073 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8a9483c7-102d-4141-92e7-440ac6523f0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:21.518616 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a9483c7-102d-4141-92e7-440ac6523f0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:21.519008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a9483c7-102d-4141-92e7-440ac6523f0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:21.519804 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a9483c7-102d-4141-92e7-440ac6523f0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:21.520236 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8a9483c7-102d-4141-92e7-440ac6523f0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:21.678987 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8a9483c7-102d-4141-92e7-440ac6523f0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:21.686876 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8a9483c7-102d-4141-92e7-440ac6523f0e tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.181589 Jul 21 08:37:21.695092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 429/863] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:21 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:22.705017 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f5e6bc79-8c9f-4c28-9397-bb2c203e1b67 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:22.705630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f5e6bc79-8c9f-4c28-9397-bb2c203e1b67 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:22.712337 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5e6bc79-8c9f-4c28-9397-bb2c203e1b67 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:22.712718 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5e6bc79-8c9f-4c28-9397-bb2c203e1b67 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:22.713567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5e6bc79-8c9f-4c28-9397-bb2c203e1b67 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:22.713927 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5e6bc79-8c9f-4c28-9397-bb2c203e1b67 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:22.769614 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b34495b1-2e01-41cf-87be-6a8799e9e896 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: .version_select at 0x7f65bc5c1160>, body: {"keypair": {"name": "tempest-keypair-586603716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/8lWJFUHHNfGIE3Fd3XbRRVISlwPiKZFwDV/ZNDsBq7NoY1FXC3Oba010jvRX9GBBLFgq2iif1bubrkW+CITbZZ9fiYtNk5gDu7ZIeNbTMgaTMO2rLhgbnoruQK4vC4w=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:22.784353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-b34495b1-2e01-41cf-87be-6a8799e9e896 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for project ca704726a8064214b0507190fe51650f. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:37:22.788193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-b34495b1-2e01-41cf-87be-6a8799e9e896 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for user 7baa0b2ddca4431b8d006873ca90ab2c and project ca704726a8064214b0507190fe51650f. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:37:22.811511 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b34495b1-2e01-41cf-87be-6a8799e9e896 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046197 Jul 21 08:37:22.815463 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 430/864] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:37:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:37:22.857792 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f5e6bc79-8c9f-4c28-9397-bb2c203e1b67 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:22.865373 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f5e6bc79-8c9f-4c28-9397-bb2c203e1b67 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1575 microversion: 2.1 time: 0.164137 Jul 21 08:37:22.865944 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 435/865] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:22 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:23.883091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71955603-1373-4ad1-9b96-98bc068d2d9b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:23.883829 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71955603-1373-4ad1-9b96-98bc068d2d9b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:23.890722 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71955603-1373-4ad1-9b96-98bc068d2d9b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:23.891275 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71955603-1373-4ad1-9b96-98bc068d2d9b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:23.892147 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71955603-1373-4ad1-9b96-98bc068d2d9b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:23.892688 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71955603-1373-4ad1-9b96-98bc068d2d9b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:24.084527 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-71955603-1373-4ad1-9b96-98bc068d2d9b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:24.092599 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71955603-1373-4ad1-9b96-98bc068d2d9b tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1562 microversion: 2.1 time: 0.214365 Jul 21 08:37:24.093179 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 431/866] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:23 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1562 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:24.383307 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1272136080", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84a3c360-33c3-4fe6-9eae-ca3228ce08c7"}], "security_groups": [{"name": "tempest-securitygroup--77097434"}], "key_name": "tempest-keypair-586603716", "user_data": "}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:24.390517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=66 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:24.486788 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] validate_networks() for [('84a3c360-33c3-4fe6-9eae-ca3228ce08c7', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:37:24.851352 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:37:24.851769 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:37:24.852245 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:37:24.852650 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:37:24.853055 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:37:24.861886 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:24.862327 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:24.863124 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:24.863590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:24.882098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for project ca704726a8064214b0507190fe51650f. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:37:24.886074 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for user 7baa0b2ddca4431b8d006873ca90ab2c and project ca704726a8064214b0507190fe51650f. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:37:24.897428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:37:24.899675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:37:24.946301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1b8c9290-73e4-42ea-b54a-fd79f6422e9a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.567178 Jul 21 08:37:24.947195 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 436/867] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:37:24 2022] POST /compute/v2.1/servers => generated 400 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:37:24.957610 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0a8f6b9e-fa18-4168-badc-fd0fdc982c05 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:24.958219 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0a8f6b9e-fa18-4168-badc-fd0fdc982c05 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:25.017945 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a8f6b9e-fa18-4168-badc-fd0fdc982c05 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:25.025305 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0a8f6b9e-fa18-4168-badc-fd0fdc982c05 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1241 microversion: 2.1 time: 0.071555 Jul 21 08:37:25.025946 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 432/868] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:24 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:26.042751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8d0e32fa-c219-4b0b-a495-c14072a60b42 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:26.043392 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8d0e32fa-c219-4b0b-a495-c14072a60b42 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:26.052943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8d0e32fa-c219-4b0b-a495-c14072a60b42 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:26.053412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8d0e32fa-c219-4b0b-a495-c14072a60b42 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:26.054214 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8d0e32fa-c219-4b0b-a495-c14072a60b42 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:26.055022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8d0e32fa-c219-4b0b-a495-c14072a60b42 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:26.125685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8d0e32fa-c219-4b0b-a495-c14072a60b42 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:26.133405 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8d0e32fa-c219-4b0b-a495-c14072a60b42 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1299 microversion: 2.1 time: 0.095215 Jul 21 08:37:26.133968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 437/869] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:26 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:27.150104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0d39a159-204e-4d12-a8bb-24be35e24b79 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:27.150719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0d39a159-204e-4d12-a8bb-24be35e24b79 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:27.153668 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:27.160102 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d39a159-204e-4d12-a8bb-24be35e24b79 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:27.160639 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d39a159-204e-4d12-a8bb-24be35e24b79 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:27.161495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d39a159-204e-4d12-a8bb-24be35e24b79 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:27.162150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d39a159-204e-4d12-a8bb-24be35e24b79 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:27.309803 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0d39a159-204e-4d12-a8bb-24be35e24b79 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:27.317530 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0d39a159-204e-4d12-a8bb-24be35e24b79 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1365 microversion: 2.1 time: 0.171258 Jul 21 08:37:27.329053 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 433/870] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:27 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:27.337728 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-332f908a-323c-46c4-bbf4-963700fd8160 req-0cb2ec5d-6714-49f8-b93f-52b51d0022e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879c0ce7-ad97-44ce-96fd-b8bbb721f271", "tag": "07abd5b2-a8fd-4882-8f86-5c154504d31d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:27.347070 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-332f908a-323c-46c4-bbf4-963700fd8160 req-0cb2ec5d-6714-49f8-b93f-52b51d0022e2 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:27.347852 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-332f908a-323c-46c4-bbf4-963700fd8160 req-0cb2ec5d-6714-49f8-b93f-52b51d0022e2 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:27.364272 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-332f908a-323c-46c4-bbf4-963700fd8160 req-0cb2ec5d-6714-49f8-b93f-52b51d0022e2 service nova] Creating event network-changed:07abd5b2-a8fd-4882-8f86-5c154504d31d for instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 on hv-cinder-85032 Jul 21 08:37:27.377042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-332f908a-323c-46c4-bbf4-963700fd8160 req-0cb2ec5d-6714-49f8-b93f-52b51d0022e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043858 Jul 21 08:37:27.377656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 438/871] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:37:28.334123 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e973181-2baa-4cfe-98ad-48a3f1a0f8e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:28.334646 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e973181-2baa-4cfe-98ad-48a3f1a0f8e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:28.341235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e973181-2baa-4cfe-98ad-48a3f1a0f8e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:28.341682 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e973181-2baa-4cfe-98ad-48a3f1a0f8e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:28.342441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e973181-2baa-4cfe-98ad-48a3f1a0f8e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:28.342876 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e973181-2baa-4cfe-98ad-48a3f1a0f8e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:28.471772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e973181-2baa-4cfe-98ad-48a3f1a0f8e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:28.479702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e973181-2baa-4cfe-98ad-48a3f1a0f8e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1365 microversion: 2.1 time: 0.149471 Jul 21 08:37:28.480280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 434/872] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:28 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:29.497200 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-86d56af1-a351-4877-8bce-c17311c4e6d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:29.497901 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-86d56af1-a351-4877-8bce-c17311c4e6d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:29.504834 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86d56af1-a351-4877-8bce-c17311c4e6d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:29.505264 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86d56af1-a351-4877-8bce-c17311c4e6d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:29.506054 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86d56af1-a351-4877-8bce-c17311c4e6d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:29.506501 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86d56af1-a351-4877-8bce-c17311c4e6d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:29.638548 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-86d56af1-a351-4877-8bce-c17311c4e6d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:29.645996 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-86d56af1-a351-4877-8bce-c17311c4e6d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1365 microversion: 2.1 time: 0.153028 Jul 21 08:37:29.646566 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 439/873] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:29 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:30.663455 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f27a8342-d5b6-457c-b02b-40a3ed50c6a7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:30.664062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f27a8342-d5b6-457c-b02b-40a3ed50c6a7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:30.671039 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f27a8342-d5b6-457c-b02b-40a3ed50c6a7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:30.671521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f27a8342-d5b6-457c-b02b-40a3ed50c6a7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:30.672282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f27a8342-d5b6-457c-b02b-40a3ed50c6a7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:30.672713 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f27a8342-d5b6-457c-b02b-40a3ed50c6a7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:30.809521 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f27a8342-d5b6-457c-b02b-40a3ed50c6a7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:30.820664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f27a8342-d5b6-457c-b02b-40a3ed50c6a7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1365 microversion: 2.1 time: 0.160633 Jul 21 08:37:30.821744 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 435/874] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:30 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:31.851526 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-20289906-204b-47f9-a827-533ebcaff8ed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:31.852094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-20289906-204b-47f9-a827-533ebcaff8ed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:31.858624 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20289906-204b-47f9-a827-533ebcaff8ed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:31.859067 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20289906-204b-47f9-a827-533ebcaff8ed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:31.859855 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20289906-204b-47f9-a827-533ebcaff8ed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:31.860281 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20289906-204b-47f9-a827-533ebcaff8ed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:31.989642 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-20289906-204b-47f9-a827-533ebcaff8ed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:31.997961 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-20289906-204b-47f9-a827-533ebcaff8ed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1365 microversion: 2.1 time: 0.150337 Jul 21 08:37:31.998529 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 440/875] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:31 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:33.015577 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b96d4f45-8d14-4ca6-8226-c2e5a6c96fed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:33.016090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b96d4f45-8d14-4ca6-8226-c2e5a6c96fed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:33.022542 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b96d4f45-8d14-4ca6-8226-c2e5a6c96fed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:33.022982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b96d4f45-8d14-4ca6-8226-c2e5a6c96fed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:33.023760 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b96d4f45-8d14-4ca6-8226-c2e5a6c96fed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:33.024179 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b96d4f45-8d14-4ca6-8226-c2e5a6c96fed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:33.146255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-919983cb-e34c-4068-ab29-5ea34b94e0de req-f0d77a54-0ce8-4f3d-9ea5-674d28d689e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879c0ce7-ad97-44ce-96fd-b8bbb721f271", "name": "network-vif-plugged", "status": "completed", "tag": "07abd5b2-a8fd-4882-8f86-5c154504d31d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:33.157360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-919983cb-e34c-4068-ab29-5ea34b94e0de req-f0d77a54-0ce8-4f3d-9ea5-674d28d689e3 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:33.157743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-919983cb-e34c-4068-ab29-5ea34b94e0de req-f0d77a54-0ce8-4f3d-9ea5-674d28d689e3 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:33.164830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b96d4f45-8d14-4ca6-8226-c2e5a6c96fed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:33.172495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-919983cb-e34c-4068-ab29-5ea34b94e0de req-f0d77a54-0ce8-4f3d-9ea5-674d28d689e3 service nova] Creating event network-vif-plugged:07abd5b2-a8fd-4882-8f86-5c154504d31d for instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 on hv-cinder-85032 Jul 21 08:37:33.173043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b96d4f45-8d14-4ca6-8226-c2e5a6c96fed tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1365 microversion: 2.1 time: 0.161879 Jul 21 08:37:33.182619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 436/876] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:33 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:33.183104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-919983cb-e34c-4068-ab29-5ea34b94e0de req-f0d77a54-0ce8-4f3d-9ea5-674d28d689e3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035512 Jul 21 08:37:33.183104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 441/877] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:37:34.190149 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f36e9be0-77a3-445c-8bba-bacbbbf266d8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:34.190747 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f36e9be0-77a3-445c-8bba-bacbbbf266d8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:34.197255 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36e9be0-77a3-445c-8bba-bacbbbf266d8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:34.197691 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36e9be0-77a3-445c-8bba-bacbbbf266d8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:34.198449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36e9be0-77a3-445c-8bba-bacbbbf266d8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:34.198872 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f36e9be0-77a3-445c-8bba-bacbbbf266d8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:34.332027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f36e9be0-77a3-445c-8bba-bacbbbf266d8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:34.339404 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f36e9be0-77a3-445c-8bba-bacbbbf266d8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1365 microversion: 2.1 time: 0.153214 Jul 21 08:37:34.339973 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 437/878] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:34 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:35.357436 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-900f6a4c-8b85-49e6-8208-dc384539501d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:35.358059 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-900f6a4c-8b85-49e6-8208-dc384539501d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:35.360455 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:35.361152 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:35.366999 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-900f6a4c-8b85-49e6-8208-dc384539501d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:35.367486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-900f6a4c-8b85-49e6-8208-dc384539501d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:35.368259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-900f6a4c-8b85-49e6-8208-dc384539501d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:35.368697 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-900f6a4c-8b85-49e6-8208-dc384539501d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:35.507435 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-900f6a4c-8b85-49e6-8208-dc384539501d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:37:35.515122 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-900f6a4c-8b85-49e6-8208-dc384539501d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1555 microversion: 2.1 time: 0.162721 Jul 21 08:37:35.515725 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 442/879] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:37:35 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:35.531737 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-067315d6-1e37-4e35-8465-dcd3d716ec51 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:35.532221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-067315d6-1e37-4e35-8465-dcd3d716ec51 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:35.534068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:35.539873 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-067315d6-1e37-4e35-8465-dcd3d716ec51 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:35.540316 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-067315d6-1e37-4e35-8465-dcd3d716ec51 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:35.541091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-067315d6-1e37-4e35-8465-dcd3d716ec51 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:35.541525 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-067315d6-1e37-4e35-8465-dcd3d716ec51 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:35.618520 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-067315d6-1e37-4e35-8465-dcd3d716ec51 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091154 Jul 21 08:37:35.619121 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 438/880] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 21 08:37:35 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:37:36.547059 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-63cb3fe4-833f-467f-b2d4-71df1a4b45fa req-ba28a971-5128-42cf-8c9b-9806a068ead2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879c0ce7-ad97-44ce-96fd-b8bbb721f271", "tag": "07abd5b2-a8fd-4882-8f86-5c154504d31d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:37:36.555015 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-63cb3fe4-833f-467f-b2d4-71df1a4b45fa req-ba28a971-5128-42cf-8c9b-9806a068ead2 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:36.555520 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-63cb3fe4-833f-467f-b2d4-71df1a4b45fa req-ba28a971-5128-42cf-8c9b-9806a068ead2 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:36.567500 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-63cb3fe4-833f-467f-b2d4-71df1a4b45fa req-ba28a971-5128-42cf-8c9b-9806a068ead2 service nova] Creating event network-changed:07abd5b2-a8fd-4882-8f86-5c154504d31d for instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 on hv-cinder-85032 Jul 21 08:37:36.572971 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-63cb3fe4-833f-467f-b2d4-71df1a4b45fa req-ba28a971-5128-42cf-8c9b-9806a068ead2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030569 Jul 21 08:37:36.573671 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 443/881] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:37:59.718578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=11 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:59.719395 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:59.723910 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-17360b89-3628-47f2-ad67-8bacd1f4f438 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:59.724810 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-17360b89-3628-47f2-ad67-8bacd1f4f438 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:59.731824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17360b89-3628-47f2-ad67-8bacd1f4f438 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:59.732260 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17360b89-3628-47f2-ad67-8bacd1f4f438 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:59.733039 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17360b89-3628-47f2-ad67-8bacd1f4f438 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:59.733435 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17360b89-3628-47f2-ad67-8bacd1f4f438 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:59.762044 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-17360b89-3628-47f2-ad67-8bacd1f4f438 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044773 Jul 21 08:37:59.762604 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 439/882] 10.222.0.47 () {60 vars in 1342 bytes} [Thu Jul 21 08:37:59 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:37:59.833713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:59.834462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=66 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:59.839122 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-35fff2e8-3089-4bba-aed7-73732e8df175 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:59.839736 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-35fff2e8-3089-4bba-aed7-73732e8df175 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:59.847182 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35fff2e8-3089-4bba-aed7-73732e8df175 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:59.847801 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35fff2e8-3089-4bba-aed7-73732e8df175 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:59.848572 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35fff2e8-3089-4bba-aed7-73732e8df175 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:59.849009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35fff2e8-3089-4bba-aed7-73732e8df175 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:59.876087 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-35fff2e8-3089-4bba-aed7-73732e8df175 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:37:59.951783 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-35fff2e8-3089-4bba-aed7-73732e8df175 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "DELETE /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 204 len: 0 microversion: 2.20 time: 0.119664 Jul 21 08:37:59.952289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 444/883] 10.222.0.47 () {60 vars in 1279 bytes} [Thu Jul 21 08:37:59 2022] DELETE /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 08:37:59.961405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:37:59.962004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:37:59.968143 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:59.968588 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:37:59.969350 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:37:59.969772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:00.100379 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:00.108352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:00.109850 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:00.110996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-206ab589-c076-4daa-a7c2-43497dae641f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.154129 Jul 21 08:38:00.111606 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 440/884] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:37:59 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:38:01.130216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:01.130910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:01.137863 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:01.138314 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:01.139111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:01.139603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:01.271344 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:01.282278 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:01.285551 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:01.287660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a6d41355-44ba-4278-ac19-29681d1eb55e tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1725 microversion: 2.20 time: 0.161635 Jul 21 08:38:01.288624 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 445/885] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:38:01 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:38:02.306658 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:02.307241 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:02.313818 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:02.314253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:02.315027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:02.315481 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:02.378846 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:02.386982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:02.388538 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad56309db7044cb2a86651d4149cd090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae82711d354d908d096edaae82c2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:02.389697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ec81f0da-1aa1-4481-8e8f-ae4c47899d0f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 200 len: 1657 microversion: 2.20 time: 0.087085 Jul 21 08:38:02.390262 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 441/886] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:38:02 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 1657 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 08:38:02.536183 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-2ccfce35-27d2-48a1-ad23-7cd641871d88 req-9d74fae6-9cf4-49a5-abaa-cc3d01e41a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207a7a3d-14f0-48b6-8ec4-d92b508659d3", "name": "network-vif-deleted", "tag": "5aa7f4fc-7261-46b3-85e6-fd60be720151"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:02.555019 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-2ccfce35-27d2-48a1-ad23-7cd641871d88 req-9d74fae6-9cf4-49a5-abaa-cc3d01e41a34 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:02.556041 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-2ccfce35-27d2-48a1-ad23-7cd641871d88 req-9d74fae6-9cf4-49a5-abaa-cc3d01e41a34 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:02.578304 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-2ccfce35-27d2-48a1-ad23-7cd641871d88 req-9d74fae6-9cf4-49a5-abaa-cc3d01e41a34 service nova] Creating event network-vif-deleted:5aa7f4fc-7261-46b3-85e6-fd60be720151 for instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 on hv-cinder-85032 Jul 21 08:38:02.586799 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-2ccfce35-27d2-48a1-ad23-7cd641871d88 req-9d74fae6-9cf4-49a5-abaa-cc3d01e41a34 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061697 Jul 21 08:38:02.588074 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 446/887] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:03.407869 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:03.408474 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:03.415671 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:03.416116 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:03.416879 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:03.417308 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:03.430436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] HTTP exception thrown: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Request method failure captured: Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 HTTP/1.1 Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6ZOMfudscQ2Kh_r70ZRWGXQGjq69QGoK_aI9kiCEtK8umxXBPaACcUp2U_rNvd-cmwPp80OZBOsaSZRfXifS3-JvSB4YrqAapxQvyXO3qykYZcpzAPtWABRpOI_WoxfEXtj2V9gSlyrLf0mwPpMOaoDkpCIP3FnlNXd0BH3YSJrX8 Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:38:03.432101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1bae82711d354d908d096edaae82c2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: ad56309db7044cb2a86651d4149cd090 Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:03.433928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '207a7a3d-14f0-48b6-8ec4-d92b508659d3'} Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:03.434752 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:03.436080 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:03.437291 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Returning 404 to user: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:03.437291 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-227b2e98-b32f-4b73-a332-42810d958570 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 404 len: 111 microversion: 2.20 time: 0.029559 Jul 21 08:38:03.437291 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 442/888] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:38:03 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:38:03.445252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2e04c879-7d33-4bed-b30d-ccfd58dbcb1f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '.version_select at 0x7f65bc34ce50>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:03.463626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2e04c879-7d33-4bed-b30d-ccfd58dbcb1f tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758411173" status: 204 len: 0 microversion: 2.20 time: 0.024137 Jul 21 08:38:03.464199 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 447/889] 10.222.0.47 () {60 vars in 1261 bytes} [Thu Jul 21 08:38:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758411173 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 08:38:05.212396 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:05.213596 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:05.219306 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:05.219782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:05.220542 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:05.220975 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:05.234223 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] HTTP exception thrown: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Request method failure captured: Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 HTTP/1.1 Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6ZOMfudscQ2Kh_r70ZRWGXQGjq69QGoK_aI9kiCEtK8umxXBPaACcUp2U_rNvd-cmwPp80OZBOsaSZRfXifS3-JvSB4YrqAapxQvyXO3qykYZcpzAPtWABRpOI_WoxfEXtj2V9gSlyrLf0mwPpMOaoDkpCIP3FnlNXd0BH3YSJrX8 Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:38:05.235797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1bae82711d354d908d096edaae82c2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: ad56309db7044cb2a86651d4149cd090 Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.237512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '207a7a3d-14f0-48b6-8ec4-d92b508659d3'} Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:05.238409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.239994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.241544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Returning 404 to user: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:05.241544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ec21f6e-6090-4529-91cc-ce9e3a24de62 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "DELETE /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 404 len: 111 microversion: 2.20 time: 0.028608 Jul 21 08:38:05.241544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 443/890] 10.222.0.47 () {60 vars in 1279 bytes} [Thu Jul 21 08:38:05 2022] DELETE /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:38:05.246035 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:05.246773 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: 207a7a3d-14f0-48b6-8ec4-d92b508659d3] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:05.254911 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:05.255396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:05.256181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:05.256617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:05.270644 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] HTTP exception thrown: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Request method failure captured: Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 HTTP/1.1 Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q6ZOMfudscQ2Kh_r70ZRWGXQGjq69QGoK_aI9kiCEtK8umxXBPaACcUp2U_rNvd-cmwPp80OZBOsaSZRfXifS3-JvSB4YrqAapxQvyXO3qykYZcpzAPtWABRpOI_WoxfEXtj2V9gSlyrLf0mwPpMOaoDkpCIP3FnlNXd0BH3YSJrX8 Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:38:05.272338 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1bae82711d354d908d096edaae82c2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: ad56309db7044cb2a86651d4149cd090 Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.274254 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '207a7a3d-14f0-48b6-8ec4-d92b508659d3'} Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:05.275098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. Jul 21 08:38:05.276639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:05.277954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Returning 404 to user: Instance 207a7a3d-14f0-48b6-8ec4-d92b508659d3 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:05.277954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5675540a-cce0-46b4-9260-342999ed10c7 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3" status: 404 len: 111 microversion: 2.20 time: 0.031571 Jul 21 08:38:05.277954 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 448/891] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:38:05 2022] GET /compute/v2.1/servers/207a7a3d-14f0-48b6-8ec4-d92b508659d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 08:38:06.413894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:06.414397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:06.420699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:06.421133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:06.421879 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:06.422304 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:06.435301 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] HTTP exception thrown: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Request method failure captured: Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a HTTP/1.1 Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2Q6ZOMfudscQ2Kh_r70ZRWGXQGjq69QGoK_aI9kiCEtK8umxXBPaACcUp2U_rNvd-cmwPp80OZBOsaSZRfXifS3-JvSB4YrqAapxQvyXO3qykYZcpzAPtWABRpOI_WoxfEXtj2V9gSlyrLf0mwPpMOaoDkpCIP3FnlNXd0BH3YSJrX8 Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:38:06.436824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1bae82711d354d908d096edaae82c2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: ad56309db7044cb2a86651d4149cd090 Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.438454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a'} Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:06.439555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.441079 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.442726 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Returning 404 to user: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:06.442726 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc173149-16f1-4a79-a87d-3e1214908236 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 404 len: 111 microversion: 2.20 time: 0.028826 Jul 21 08:38:06.442726 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 444/892] 10.222.0.47 () {60 vars in 1279 bytes} [Thu Jul 21 08:38:06 2022] DELETE /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:38:06.449495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:06.450131 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] [instance: f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:06.458334 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:06.458779 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:06.459578 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:06.460012 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:06.474235 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] HTTP exception thrown: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Request method failure captured: Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a HTTP/1.1 Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q6ZOMfudscQ2Kh_r70ZRWGXQGjq69QGoK_aI9kiCEtK8umxXBPaACcUp2U_rNvd-cmwPp80OZBOsaSZRfXifS3-JvSB4YrqAapxQvyXO3qykYZcpzAPtWABRpOI_WoxfEXtj2V9gSlyrLf0mwPpMOaoDkpCIP3FnlNXd0BH3YSJrX8 Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:38:06.475831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1bae82711d354d908d096edaae82c2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1bae82711d354d908d096edaae82c2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 1bae82711d354d908d096edaae82c2c5 Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-261213168 Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: ad56309db7044cb2a86651d4149cd090 Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeShelveTestJSON-261213168-project Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.477333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a'} Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:06.478166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. Jul 21 08:38:06.479442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:06.480513 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] Returning 404 to user: Instance f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:06.480513 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e0efce6a-5278-4039-94dc-46a16251a477 tempest-AttachVolumeShelveTestJSON-261213168 tempest-AttachVolumeShelveTestJSON-261213168-project] 10.222.0.47 "GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a" status: 404 len: 111 microversion: 2.20 time: 0.033875 Jul 21 08:38:06.480513 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 449/893] 10.222.0.47 () {60 vars in 1276 bytes} [Thu Jul 21 08:38:06 2022] GET /compute/v2.1/servers/f0c9d26e-e2e1-4d98-8d77-1ef55de7b87a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:38:15.239196 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0b57a4a-b3bf-40ae-8742-0ccf52dff42c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'create', calling method: .version_select at 0x7f65c0b8c3a0>, body: {"keypair": {"name": "tempest-keypair-619783907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsX9C/3ZhPy5/FQfZEE6MxBPTChSwiXiY40pqZZcS+kcDFf+DDg6bibR0J5e8Xx3u3+NOGWk4sLFdrvu2PZhhx8dol56pLBGTXNRminh7BwE7ucmjT46TBpk0DLMZi2EA=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:15.254008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-e0b57a4a-b3bf-40ae-8742-0ccf52dff42c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Getting quotas for project d588f87ef1d248528ec37cd9b5d43dcc. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:38:15.258030 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-e0b57a4a-b3bf-40ae-8742-0ccf52dff42c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Getting quotas for user 591ec12e19db47139d3a73484abf2f0d and project d588f87ef1d248528ec37cd9b5d43dcc. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:38:15.282118 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0b57a4a-b3bf-40ae-8742-0ccf52dff42c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.198212 Jul 21 08:38:15.288549 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 445/894] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:38:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:16.627125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-77561718", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1faf8c46-062e-421f-966c-780575268200"}], "security_groups": [{"name": "tempest-securitygroup--1687453376"}], "key_name": "tempest-keypair-619783907", "user_data": "}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:16.634752 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:16.635449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:16.735265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] validate_networks() for [('1faf8c46-062e-421f-966c-780575268200', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:38:17.126574 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:38:17.126992 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:38:17.127635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:38:17.128991 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:38:17.129409 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:38:17.138802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:17.139252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:17.140079 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:17.140512 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:17.157673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Getting quotas for project d588f87ef1d248528ec37cd9b5d43dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:38:17.162215 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Getting quotas for user 591ec12e19db47139d3a73484abf2f0d and project d588f87ef1d248528ec37cd9b5d43dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:38:17.173382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:38:17.176104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:38:17.229846 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5242e360-d070-43b4-9454-e1b267be568e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.607097 Jul 21 08:38:17.231469 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 450/895] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:38:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:38:17.241016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b27a6909-bb29-4317-affc-0542ddb1f8c4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:17.241631 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b27a6909-bb29-4317-affc-0542ddb1f8c4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:17.244162 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=24 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:17.332878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b27a6909-bb29-4317-affc-0542ddb1f8c4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:17.340021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b27a6909-bb29-4317-affc-0542ddb1f8c4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1235 microversion: 2.1 time: 0.102834 Jul 21 08:38:17.340930 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 446/896] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:17 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1235 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:18.358273 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3e9a62a7-0638-4527-9143-e7ab88308b3b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:18.359044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3e9a62a7-0638-4527-9143-e7ab88308b3b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:18.366660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e9a62a7-0638-4527-9143-e7ab88308b3b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:18.367121 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e9a62a7-0638-4527-9143-e7ab88308b3b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:18.367940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e9a62a7-0638-4527-9143-e7ab88308b3b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:18.368380 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e9a62a7-0638-4527-9143-e7ab88308b3b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:18.432420 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3e9a62a7-0638-4527-9143-e7ab88308b3b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:18.440036 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3e9a62a7-0638-4527-9143-e7ab88308b3b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1287 microversion: 2.1 time: 0.086113 Jul 21 08:38:18.440659 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 451/897] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:18 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:19.460847 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ff83226-e9e2-4f74-b8ed-9d2cc41971b9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:19.462715 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ff83226-e9e2-4f74-b8ed-9d2cc41971b9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:19.478141 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ff83226-e9e2-4f74-b8ed-9d2cc41971b9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:19.479082 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ff83226-e9e2-4f74-b8ed-9d2cc41971b9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:19.480145 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ff83226-e9e2-4f74-b8ed-9d2cc41971b9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:19.481272 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ff83226-e9e2-4f74-b8ed-9d2cc41971b9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:19.638705 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ff83226-e9e2-4f74-b8ed-9d2cc41971b9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:19.652442 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ff83226-e9e2-4f74-b8ed-9d2cc41971b9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1361 microversion: 2.1 time: 0.199271 Jul 21 08:38:19.653529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 447/898] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:19 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:20.086206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-1d3e1815-df59-49c7-87e1-a5a443703082 req-087fc8fd-4232-4447-b866-df6f96e30cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4765bcf7-c1c0-48bc-92d9-2d6b53cad403", "tag": "f1a1b98b-aa28-4bb1-ad48-eca57a3a9e49"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:20.098986 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-1d3e1815-df59-49c7-87e1-a5a443703082 req-087fc8fd-4232-4447-b866-df6f96e30cb2 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.108891 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-1d3e1815-df59-49c7-87e1-a5a443703082 req-087fc8fd-4232-4447-b866-df6f96e30cb2 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.124679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-1d3e1815-df59-49c7-87e1-a5a443703082 req-087fc8fd-4232-4447-b866-df6f96e30cb2 service nova] Creating event network-changed:f1a1b98b-aa28-4bb1-ad48-eca57a3a9e49 for instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 on hv-cinder-85032 Jul 21 08:38:20.130442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-1d3e1815-df59-49c7-87e1-a5a443703082 req-087fc8fd-4232-4447-b866-df6f96e30cb2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048512 Jul 21 08:38:20.131059 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 452/899] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:20.333231 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a088d994-61f9-4bb9-8241-65b45743e971 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:20.333715 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a088d994-61f9-4bb9-8241-65b45743e971 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:20.339982 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a088d994-61f9-4bb9-8241-65b45743e971 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.340421 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a088d994-61f9-4bb9-8241-65b45743e971 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.341174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a088d994-61f9-4bb9-8241-65b45743e971 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.341598 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a088d994-61f9-4bb9-8241-65b45743e971 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.367315 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a088d994-61f9-4bb9-8241-65b45743e971 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271/ips" status: 200 len: 149 microversion: 2.1 time: 0.037594 Jul 21 08:38:20.368201 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 448/900] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:38:20 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:20.380485 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:20.381677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:20.388201 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.388656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.389434 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.389876 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.475911 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Invalid volume: volume 8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2 is already attached to instances: da9b5c0f-6620-4aaf-bc46-be3c69cd4145 Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: POST /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271/os-volume_attachments HTTP/1.1 Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 74 Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:38:20.477921 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {"volumeAttachment": {"volumeId": "8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2"}} Jul 21 08:38:20.479581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Invalid volume: volume 8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2 is already attached to instances: da9b5c0f-6620-4aaf-bc46-be3c69cd4145 Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '879c0ce7-ad97-44ce-96fd-b8bbb721f271', 'body': {'volumeAttachment': {'volumeId': '8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2'}}} Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2 is already attached to instances: da9b5c0f-6620-4aaf-bc46-be3c69cd4145 Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:20.480519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2 is already attached to instances: da9b5c0f-6620-4aaf-bc46-be3c69cd4145 Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:20.481923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:20.483154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:20.483154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:20.483154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:20.483154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2 is already attached to instances: da9b5c0f-6620-4aaf-bc46-be3c69cd4145 Jul 21 08:38:20.483154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:20.483154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 400 to user: Invalid volume: volume 8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2 is already attached to instances: da9b5c0f-6620-4aaf-bc46-be3c69cd4145 {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:20.483154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ac0a3282-7c4b-4bab-a7f1-b85c28fe3244 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103634 Jul 21 08:38:20.483154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 453/901] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:38:20 2022] POST /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:38:20.492716 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-110bfa0f-6630-412e-956e-14c6f9f86e65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:20.493240 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-110bfa0f-6630-412e-956e-14c6f9f86e65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:20.499685 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-110bfa0f-6630-412e-956e-14c6f9f86e65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.500130 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-110bfa0f-6630-412e-956e-14c6f9f86e65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.500890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-110bfa0f-6630-412e-956e-14c6f9f86e65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.501326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-110bfa0f-6630-412e-956e-14c6f9f86e65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.526819 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-110bfa0f-6630-412e-956e-14c6f9f86e65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:38:20.610498 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-110bfa0f-6630-412e-956e-14c6f9f86e65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 204 len: 0 microversion: 2.1 time: 0.120780 Jul 21 08:38:20.611375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 449/902] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:38:20 2022] DELETE /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:38:20.621484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-81a46882-e209-4303-a08d-b92424823168 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:20.622110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-81a46882-e209-4303-a08d-b92424823168 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:20.631179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81a46882-e209-4303-a08d-b92424823168 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.631663 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81a46882-e209-4303-a08d-b92424823168 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.632442 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81a46882-e209-4303-a08d-b92424823168 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.632886 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81a46882-e209-4303-a08d-b92424823168 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.673366 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d9dab1a-3845-4174-ae10-a9e23334535e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:20.674692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d9dab1a-3845-4174-ae10-a9e23334535e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:20.682464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d9dab1a-3845-4174-ae10-a9e23334535e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.683055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d9dab1a-3845-4174-ae10-a9e23334535e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.683904 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d9dab1a-3845-4174-ae10-a9e23334535e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:20.684425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d9dab1a-3845-4174-ae10-a9e23334535e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:20.771182 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-81a46882-e209-4303-a08d-b92424823168 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:20.779078 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-81a46882-e209-4303-a08d-b92424823168 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1679 microversion: 2.1 time: 0.161558 Jul 21 08:38:20.779699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 454/903] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:20 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:20.819431 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d9dab1a-3845-4174-ae10-a9e23334535e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:20.826880 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d9dab1a-3845-4174-ae10-a9e23334535e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1361 microversion: 2.1 time: 0.159732 Jul 21 08:38:20.827475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 450/904] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:20 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:38:21.795666 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0e6260fd-f6ae-4200-9ba6-073e74bc90c5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:21.796277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0e6260fd-f6ae-4200-9ba6-073e74bc90c5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:21.802701 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e6260fd-f6ae-4200-9ba6-073e74bc90c5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:21.803143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e6260fd-f6ae-4200-9ba6-073e74bc90c5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:21.804995 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e6260fd-f6ae-4200-9ba6-073e74bc90c5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:21.804995 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e6260fd-f6ae-4200-9ba6-073e74bc90c5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:21.843722 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1925576b-104b-4ffd-8b5c-7f1466db413a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:21.844269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1925576b-104b-4ffd-8b5c-7f1466db413a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:21.850928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1925576b-104b-4ffd-8b5c-7f1466db413a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:21.851431 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1925576b-104b-4ffd-8b5c-7f1466db413a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:21.852201 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1925576b-104b-4ffd-8b5c-7f1466db413a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:21.852660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1925576b-104b-4ffd-8b5c-7f1466db413a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:21.934958 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0e6260fd-f6ae-4200-9ba6-073e74bc90c5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:21.943095 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0e6260fd-f6ae-4200-9ba6-073e74bc90c5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1679 microversion: 2.1 time: 0.151238 Jul 21 08:38:21.943713 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 455/905] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:21 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:21.983777 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1925576b-104b-4ffd-8b5c-7f1466db413a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:21.992259 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1925576b-104b-4ffd-8b5c-7f1466db413a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1361 microversion: 2.1 time: 0.152413 Jul 21 08:38:21.992841 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 451/906] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:21 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:38:22.960873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-85744949-03a5-4a0d-8ec4-1f8f4f83685e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:22.961789 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-85744949-03a5-4a0d-8ec4-1f8f4f83685e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:22.968355 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85744949-03a5-4a0d-8ec4-1f8f4f83685e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:22.969009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85744949-03a5-4a0d-8ec4-1f8f4f83685e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:22.969784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85744949-03a5-4a0d-8ec4-1f8f4f83685e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:22.970213 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85744949-03a5-4a0d-8ec4-1f8f4f83685e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:23.012212 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-100744f6-2e45-41cd-b05a-b0993ba26f0d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:23.013069 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-100744f6-2e45-41cd-b05a-b0993ba26f0d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:23.020696 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-100744f6-2e45-41cd-b05a-b0993ba26f0d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:23.021484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-100744f6-2e45-41cd-b05a-b0993ba26f0d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:23.022512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-100744f6-2e45-41cd-b05a-b0993ba26f0d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:23.023138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-100744f6-2e45-41cd-b05a-b0993ba26f0d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:23.185848 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-85744949-03a5-4a0d-8ec4-1f8f4f83685e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:23.194901 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-85744949-03a5-4a0d-8ec4-1f8f4f83685e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1679 microversion: 2.1 time: 0.237750 Jul 21 08:38:23.195961 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 456/907] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:22 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:23.551584 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-100744f6-2e45-41cd-b05a-b0993ba26f0d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:23.559390 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-100744f6-2e45-41cd-b05a-b0993ba26f0d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1361 microversion: 2.1 time: 0.550973 Jul 21 08:38:23.570231 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 452/908] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:23 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:38:24.211944 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-447b88c9-ed27-434d-a654-3503518edbf8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:24.212699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-447b88c9-ed27-434d-a654-3503518edbf8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:24.219188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-447b88c9-ed27-434d-a654-3503518edbf8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:24.219678 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-447b88c9-ed27-434d-a654-3503518edbf8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:24.220450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-447b88c9-ed27-434d-a654-3503518edbf8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:24.220890 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-447b88c9-ed27-434d-a654-3503518edbf8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:24.286053 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-447b88c9-ed27-434d-a654-3503518edbf8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:24.293650 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-447b88c9-ed27-434d-a654-3503518edbf8 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 200 len: 1613 microversion: 2.1 time: 0.085570 Jul 21 08:38:24.294468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 457/909] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:24 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 1613 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:24.466367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-cbf69c4e-da4b-4782-b82c-be66eb520343 req-09430349-9888-4834-8c4e-8198d105fd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879c0ce7-ad97-44ce-96fd-b8bbb721f271", "name": "network-vif-deleted", "tag": "07abd5b2-a8fd-4882-8f86-5c154504d31d"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:24.476204 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cbf69c4e-da4b-4782-b82c-be66eb520343 req-09430349-9888-4834-8c4e-8198d105fd9a service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:24.476898 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cbf69c4e-da4b-4782-b82c-be66eb520343 req-09430349-9888-4834-8c4e-8198d105fd9a service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:24.489730 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-cbf69c4e-da4b-4782-b82c-be66eb520343 req-09430349-9888-4834-8c4e-8198d105fd9a service nova] Creating event network-vif-deleted:07abd5b2-a8fd-4882-8f86-5c154504d31d for instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 on hv-cinder-85032 Jul 21 08:38:24.494608 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-cbf69c4e-da4b-4782-b82c-be66eb520343 req-09430349-9888-4834-8c4e-8198d105fd9a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032007 Jul 21 08:38:24.495192 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 453/910] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:24.577171 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0a0d210b-cbb5-42ea-98f3-08cafde4e69c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:24.577940 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0a0d210b-cbb5-42ea-98f3-08cafde4e69c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:24.585039 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a0d210b-cbb5-42ea-98f3-08cafde4e69c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:24.585491 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a0d210b-cbb5-42ea-98f3-08cafde4e69c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:24.586294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a0d210b-cbb5-42ea-98f3-08cafde4e69c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:24.586769 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a0d210b-cbb5-42ea-98f3-08cafde4e69c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:24.750883 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0a0d210b-cbb5-42ea-98f3-08cafde4e69c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:24.761412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0a0d210b-cbb5-42ea-98f3-08cafde4e69c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1361 microversion: 2.1 time: 0.188053 Jul 21 08:38:24.761924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 458/911] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:24 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:38:25.313777 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:25.314473 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:25.321994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:25.322440 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:25.323574 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:25.324365 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:25.341093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 HTTP/1.1 Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:38:25.342728 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:38:25.344409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '879c0ce7-ad97-44ce-96fd-b8bbb721f271'} Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:25.345229 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:38:25.347280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:38:25.348583 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:25.348583 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6b8a26b1-011f-44e5-97d1-3cba170075cd tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 404 len: 111 microversion: 2.1 time: 0.035356 Jul 21 08:38:25.348583 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 454/912] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:25 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:38:25.353698 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fd7cf2f4-f81a-43ce-9cf0-a01832de3eea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '.version_select at 0x7f65bc2cc5e0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:25.376081 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fd7cf2f4-f81a-43ce-9cf0-a01832de3eea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586603716" status: 202 len: 0 microversion: 2.1 time: 0.026071 Jul 21 08:38:25.376732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 459/913] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 21 08:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586603716 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:38:25.444458 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-cc5ac30b-c701-4516-b23c-91bd5592efe0 req-c2efdf7b-a5ea-4a62-9798-091f07df44d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4765bcf7-c1c0-48bc-92d9-2d6b53cad403", "name": "network-vif-plugged", "status": "completed", "tag": "f1a1b98b-aa28-4bb1-ad48-eca57a3a9e49"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:25.457397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cc5ac30b-c701-4516-b23c-91bd5592efe0 req-c2efdf7b-a5ea-4a62-9798-091f07df44d3 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:25.458226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-cc5ac30b-c701-4516-b23c-91bd5592efe0 req-c2efdf7b-a5ea-4a62-9798-091f07df44d3 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:25.473421 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-cc5ac30b-c701-4516-b23c-91bd5592efe0 req-c2efdf7b-a5ea-4a62-9798-091f07df44d3 service nova] Creating event network-vif-plugged:f1a1b98b-aa28-4bb1-ad48-eca57a3a9e49 for instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 on hv-cinder-85032 Jul 21 08:38:25.478591 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-cc5ac30b-c701-4516-b23c-91bd5592efe0 req-c2efdf7b-a5ea-4a62-9798-091f07df44d3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037735 Jul 21 08:38:25.480050 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 455/914] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:25.778641 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ccf2dcfd-cde7-45e0-a106-19661d853f26 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:25.779264 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ccf2dcfd-cde7-45e0-a106-19661d853f26 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:25.786248 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ccf2dcfd-cde7-45e0-a106-19661d853f26 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:25.786766 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ccf2dcfd-cde7-45e0-a106-19661d853f26 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:25.787637 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ccf2dcfd-cde7-45e0-a106-19661d853f26 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:25.788370 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ccf2dcfd-cde7-45e0-a106-19661d853f26 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:25.929250 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ccf2dcfd-cde7-45e0-a106-19661d853f26 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:25.937514 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ccf2dcfd-cde7-45e0-a106-19661d853f26 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1361 microversion: 2.1 time: 0.163164 Jul 21 08:38:25.938111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 460/915] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:25 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:38:26.208421 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bee743bf-2b3b-4969-9f98-91197c649dc4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:26.208984 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bee743bf-2b3b-4969-9f98-91197c649dc4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:26.215154 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bee743bf-2b3b-4969-9f98-91197c649dc4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:26.215625 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bee743bf-2b3b-4969-9f98-91197c649dc4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:26.216370 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bee743bf-2b3b-4969-9f98-91197c649dc4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:26.216794 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bee743bf-2b3b-4969-9f98-91197c649dc4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:26.295190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-bee743bf-2b3b-4969-9f98-91197c649dc4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lazy-loading 'services' on Instance uuid da9b5c0f-6620-4aaf-bc46-be3c69cd4145 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:38:26.365712 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bee743bf-2b3b-4969-9f98-91197c649dc4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments/8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2" status: 202 len: 0 microversion: 2.1 time: 0.161262 Jul 21 08:38:26.366287 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 456/916] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:38:26 2022] DELETE /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments/8f1a3dc0-7d7a-48f5-ac8a-bf1d84d4c0f2 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 08:38:26.374834 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80c366d3-4e6c-45e4-b46a-e24b54015a15 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:26.375888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-80c366d3-4e6c-45e4-b46a-e24b54015a15 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:26.382985 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80c366d3-4e6c-45e4-b46a-e24b54015a15 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:26.383457 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80c366d3-4e6c-45e4-b46a-e24b54015a15 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:26.384212 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80c366d3-4e6c-45e4-b46a-e24b54015a15 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:26.384647 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80c366d3-4e6c-45e4-b46a-e24b54015a15 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:26.413882 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80c366d3-4e6c-45e4-b46a-e24b54015a15 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043073 Jul 21 08:38:26.414436 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 461/917] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:38:26 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:26.954939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a2adfea2-e3c3-4d83-b508-1c3dc41769a1 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:26.956250 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a2adfea2-e3c3-4d83-b508-1c3dc41769a1 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:26.962580 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2adfea2-e3c3-4d83-b508-1c3dc41769a1 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:26.963025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2adfea2-e3c3-4d83-b508-1c3dc41769a1 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:26.963810 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2adfea2-e3c3-4d83-b508-1c3dc41769a1 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:26.964243 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2adfea2-e3c3-4d83-b508-1c3dc41769a1 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:27.092032 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a2adfea2-e3c3-4d83-b508-1c3dc41769a1 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:27.101038 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a2adfea2-e3c3-4d83-b508-1c3dc41769a1 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1361 microversion: 2.1 time: 0.150558 Jul 21 08:38:27.101651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 457/918] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:26 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:27.425580 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-008ece94-6e0a-4199-9703-9735695e030f tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:27.426495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-008ece94-6e0a-4199-9703-9735695e030f tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:27.428438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:27.429188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:27.435825 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-008ece94-6e0a-4199-9703-9735695e030f tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:27.436268 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-008ece94-6e0a-4199-9703-9735695e030f tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:27.437023 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-008ece94-6e0a-4199-9703-9735695e030f tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:27.437454 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-008ece94-6e0a-4199-9703-9735695e030f tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:27.472913 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-008ece94-6e0a-4199-9703-9735695e030f tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051636 Jul 21 08:38:27.473956 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 462/919] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:38:27 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:28.118253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd2ac2a5-da98-42dc-8708-5c56be5d32a3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:28.118859 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd2ac2a5-da98-42dc-8708-5c56be5d32a3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:28.120946 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:28.129340 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd2ac2a5-da98-42dc-8708-5c56be5d32a3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.129785 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd2ac2a5-da98-42dc-8708-5c56be5d32a3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.130580 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd2ac2a5-da98-42dc-8708-5c56be5d32a3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.131015 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd2ac2a5-da98-42dc-8708-5c56be5d32a3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.276884 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd2ac2a5-da98-42dc-8708-5c56be5d32a3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:28.285364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd2ac2a5-da98-42dc-8708-5c56be5d32a3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1547 microversion: 2.1 time: 0.171131 Jul 21 08:38:28.285933 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 458/920] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:28 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:28.301527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-62f2dfbf-7c21-4e35-a26c-f95ceec80ea0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:28.302019 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-62f2dfbf-7c21-4e35-a26c-f95ceec80ea0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:28.308038 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f2dfbf-7c21-4e35-a26c-f95ceec80ea0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.308491 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f2dfbf-7c21-4e35-a26c-f95ceec80ea0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.309257 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f2dfbf-7c21-4e35-a26c-f95ceec80ea0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.309689 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f2dfbf-7c21-4e35-a26c-f95ceec80ea0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.388848 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-62f2dfbf-7c21-4e35-a26c-f95ceec80ea0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091137 Jul 21 08:38:28.389440 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 463/921] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 21 08:38:28 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:28.485429 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a75c5b2e-98b5-41eb-97e1-e306dbc0430e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:28.486412 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a75c5b2e-98b5-41eb-97e1-e306dbc0430e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:28.493038 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a75c5b2e-98b5-41eb-97e1-e306dbc0430e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.493554 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a75c5b2e-98b5-41eb-97e1-e306dbc0430e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.494231 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a75c5b2e-98b5-41eb-97e1-e306dbc0430e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.494651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a75c5b2e-98b5-41eb-97e1-e306dbc0430e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.524055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a75c5b2e-98b5-41eb-97e1-e306dbc0430e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042530 Jul 21 08:38:28.524678 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 459/922] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:38:28 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:38:28.584512 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-691f5cf2-0559-4c47-a990-7528a51a8faa tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:28.585109 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-691f5cf2-0559-4c47-a990-7528a51a8faa tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:28.591035 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-691f5cf2-0559-4c47-a990-7528a51a8faa tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.591530 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-691f5cf2-0559-4c47-a990-7528a51a8faa tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.592306 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-691f5cf2-0559-4c47-a990-7528a51a8faa tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.592749 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-691f5cf2-0559-4c47-a990-7528a51a8faa tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.618307 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-691f5cf2-0559-4c47-a990-7528a51a8faa tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:38:28.696937 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-691f5cf2-0559-4c47-a990-7528a51a8faa tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 204 len: 0 microversion: 2.1 time: 0.116553 Jul 21 08:38:28.697690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 464/923] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:38:28 2022] DELETE /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:38:28.706736 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-14070854-ec8f-44fe-9ee8-90e2322dff0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:28.707493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-14070854-ec8f-44fe-9ee8-90e2322dff0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:28.713585 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14070854-ec8f-44fe-9ee8-90e2322dff0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.714105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14070854-ec8f-44fe-9ee8-90e2322dff0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.714936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14070854-ec8f-44fe-9ee8-90e2322dff0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:28.715484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14070854-ec8f-44fe-9ee8-90e2322dff0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:28.851639 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-14070854-ec8f-44fe-9ee8-90e2322dff0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:28.859533 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-14070854-ec8f-44fe-9ee8-90e2322dff0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1683 microversion: 2.1 time: 0.157207 Jul 21 08:38:28.860253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 460/924] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:28 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:29.579862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-33f8cd20-7717-4ee0-b9e8-300313fdecdf req-c042c3ac-29a1-4c65-819d-301eb9346a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4765bcf7-c1c0-48bc-92d9-2d6b53cad403", "tag": "f1a1b98b-aa28-4bb1-ad48-eca57a3a9e49"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:29.588315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-33f8cd20-7717-4ee0-b9e8-300313fdecdf req-c042c3ac-29a1-4c65-819d-301eb9346a8c service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:29.588950 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-33f8cd20-7717-4ee0-b9e8-300313fdecdf req-c042c3ac-29a1-4c65-819d-301eb9346a8c service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:29.600035 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-33f8cd20-7717-4ee0-b9e8-300313fdecdf req-c042c3ac-29a1-4c65-819d-301eb9346a8c service nova] Creating event network-changed:f1a1b98b-aa28-4bb1-ad48-eca57a3a9e49 for instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 on hv-cinder-85032 Jul 21 08:38:29.605063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-33f8cd20-7717-4ee0-b9e8-300313fdecdf req-c042c3ac-29a1-4c65-819d-301eb9346a8c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029228 Jul 21 08:38:29.605677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 465/925] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:29.878298 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e649055-549e-408f-a8b2-283832eee694 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:29.878979 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e649055-549e-408f-a8b2-283832eee694 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:29.881312 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:29.887041 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e649055-549e-408f-a8b2-283832eee694 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:29.887526 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e649055-549e-408f-a8b2-283832eee694 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:29.888295 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e649055-549e-408f-a8b2-283832eee694 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:29.888727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e649055-549e-408f-a8b2-283832eee694 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:30.022409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1e649055-549e-408f-a8b2-283832eee694 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:30.030357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e649055-549e-408f-a8b2-283832eee694 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1683 microversion: 2.1 time: 0.156637 Jul 21 08:38:30.030942 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 461/926] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:29 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:31.048475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d5bf3dd7-ab70-4ebc-a945-ec86d69084ec tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:31.049328 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d5bf3dd7-ab70-4ebc-a945-ec86d69084ec tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:31.056025 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5bf3dd7-ab70-4ebc-a945-ec86d69084ec tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:31.056498 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5bf3dd7-ab70-4ebc-a945-ec86d69084ec tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:31.057270 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5bf3dd7-ab70-4ebc-a945-ec86d69084ec tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:31.057707 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5bf3dd7-ab70-4ebc-a945-ec86d69084ec tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:31.203683 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d5bf3dd7-ab70-4ebc-a945-ec86d69084ec tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:31.213137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d5bf3dd7-ab70-4ebc-a945-ec86d69084ec tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 200 len: 1683 microversion: 2.1 time: 0.168806 Jul 21 08:38:31.213733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 466/927] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:31 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:31.708782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-4e026f9c-203f-43f5-a295-4901bec56a65 req-8c27c6e9-cbae-44fb-b7e3-25fdbd37ef1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9b5c0f-6620-4aaf-bc46-be3c69cd4145", "name": "network-vif-deleted", "tag": "56b8d356-6397-47a7-ba19-1dbd4e2f0ee7"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:31.720605 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-4e026f9c-203f-43f5-a295-4901bec56a65 req-8c27c6e9-cbae-44fb-b7e3-25fdbd37ef1c service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:31.721767 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-4e026f9c-203f-43f5-a295-4901bec56a65 req-8c27c6e9-cbae-44fb-b7e3-25fdbd37ef1c service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:31.736127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-4e026f9c-203f-43f5-a295-4901bec56a65 req-8c27c6e9-cbae-44fb-b7e3-25fdbd37ef1c service nova] Creating event network-vif-deleted:56b8d356-6397-47a7-ba19-1dbd4e2f0ee7 for instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 on hv-cinder-85032 Jul 21 08:38:31.741408 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-4e026f9c-203f-43f5-a295-4901bec56a65 req-8c27c6e9-cbae-44fb-b7e3-25fdbd37ef1c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037585 Jul 21 08:38:31.742016 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 462/928] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:32.230122 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:32.230751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:32.237244 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:32.237780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:32.238622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:32.239153 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:32.254023 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 HTTP/1.1 Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:38:32.255712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:38:32.257290 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'da9b5c0f-6620-4aaf-bc46-be3c69cd4145'} Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:32.258449 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:38:32.259965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:32.261991 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:32.261991 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d55aaaa4-6030-4a74-a7fd-0c45e81fdae1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 404 len: 111 microversion: 2.1 time: 0.031011 Jul 21 08:38:32.261991 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 467/929] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:32 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:38:32.266636 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0789ae47-00bd-4007-886d-c732c4bda087 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '.version_select at 0x7f65c0bad0d0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:32.285206 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0789ae47-00bd-4007-886d-c732c4bda087 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639870569" status: 202 len: 0 microversion: 2.1 time: 0.022486 Jul 21 08:38:32.286531 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 463/930] 10.222.0.47 () {58 vars in 1220 bytes} [Thu Jul 21 08:38:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639870569 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:38:32.928765 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a59fb17d-9feb-4292-9828-3dfa89f03a99 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: .version_select at 0x7f65bc3d7280>, body: {"keypair": {"name": "tempest-keypair-179103194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7v0fVzBLTTGEDVKFOL3hjd4ryG1R5k4GweIk3FGNyG4g6kT+q/+vtiJ5BqwTQDC9HnyT761JOgxem7r8s9TIFv0F+27zyMAX2DuyqeRR+WlODxNxMNy+OLyhZ8JdHonw=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:32.942360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-a59fb17d-9feb-4292-9828-3dfa89f03a99 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for project ca704726a8064214b0507190fe51650f. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:38:32.946121 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-a59fb17d-9feb-4292-9828-3dfa89f03a99 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for user 7baa0b2ddca4431b8d006873ca90ab2c and project ca704726a8064214b0507190fe51650f. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:38:32.967194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a59fb17d-9feb-4292-9828-3dfa89f03a99 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042790 Jul 21 08:38:32.967800 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 468/931] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:38:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:34.251133 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-275012459", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84a3c360-33c3-4fe6-9eae-ca3228ce08c7"}], "security_groups": [{"name": "tempest-securitygroup--1069932976"}], "key_name": "tempest-keypair-179103194", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:34.353774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] validate_networks() for [('84a3c360-33c3-4fe6-9eae-ca3228ce08c7', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:38:34.727500 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:38:34.727921 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:38:34.728412 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:38:34.728831 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:38:34.729236 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:38:34.738354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:34.738798 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:34.739620 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:34.740081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:34.756433 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for project ca704726a8064214b0507190fe51650f. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:38:34.760248 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for user 7baa0b2ddca4431b8d006873ca90ab2c and project ca704726a8064214b0507190fe51650f. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:38:34.771274 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:38:34.773590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:38:34.816660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR oslo.messaging._drivers.impl_rabbit [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [8429243e-0f8c-4007-832e-3278a51ffbb0] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 08:38:35.824340 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [8429243e-0f8c-4007-832e-3278a51ffbb0] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 56090. Jul 21 08:38:35.828802 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-033985d4-8c0d-47cb-b7ff-087ee5ad02b5 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.581965 Jul 21 08:38:35.829483 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 464/932] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:38:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:38:35.839620 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a37b1fb0-9f88-4104-8fac-9f6d51c37611 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:35.840246 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a37b1fb0-9f88-4104-8fac-9f6d51c37611 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:35.899531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a37b1fb0-9f88-4104-8fac-9f6d51c37611 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:35.907716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a37b1fb0-9f88-4104-8fac-9f6d51c37611 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1240 microversion: 2.1 time: 0.071967 Jul 21 08:38:35.908798 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 469/933] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:35 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:36.925912 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a6b92fe7-79c6-4568-b663-0f5795c4bf65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:36.926524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a6b92fe7-79c6-4568-b663-0f5795c4bf65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:36.932848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6b92fe7-79c6-4568-b663-0f5795c4bf65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:36.933298 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6b92fe7-79c6-4568-b663-0f5795c4bf65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:36.934051 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6b92fe7-79c6-4568-b663-0f5795c4bf65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:36.934484 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6b92fe7-79c6-4568-b663-0f5795c4bf65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:37.005632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a6b92fe7-79c6-4568-b663-0f5795c4bf65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:37.009172 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:37.014201 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a6b92fe7-79c6-4568-b663-0f5795c4bf65 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1298 microversion: 2.1 time: 0.093173 Jul 21 08:38:37.014789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 465/934] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:36 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:38.031637 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4f5fe4ea-8413-4f07-ae56-e43af225b8be tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:38.032973 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4f5fe4ea-8413-4f07-ae56-e43af225b8be tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:38.039509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f5fe4ea-8413-4f07-ae56-e43af225b8be tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:38.039957 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f5fe4ea-8413-4f07-ae56-e43af225b8be tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:38.041038 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f5fe4ea-8413-4f07-ae56-e43af225b8be tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:38.041475 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f5fe4ea-8413-4f07-ae56-e43af225b8be tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:38.182003 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4f5fe4ea-8413-4f07-ae56-e43af225b8be tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:38.185760 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:38.191283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4f5fe4ea-8413-4f07-ae56-e43af225b8be tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1366 microversion: 2.1 time: 0.163758 Jul 21 08:38:38.191893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 470/935] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:38 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:38.231612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-0cddb696-3581-4915-bcf6-3e0656174d85 req-bc213afd-98f9-4477-aecc-b613ca065c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02a2f09-54d5-4788-800e-d2e7e3de4fff", "tag": "e0695de7-055e-4c95-adf1-7ad9d8d04201"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:38.254477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0cddb696-3581-4915-bcf6-3e0656174d85 req-bc213afd-98f9-4477-aecc-b613ca065c73 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:38.254939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0cddb696-3581-4915-bcf6-3e0656174d85 req-bc213afd-98f9-4477-aecc-b613ca065c73 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:38.267005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-0cddb696-3581-4915-bcf6-3e0656174d85 req-bc213afd-98f9-4477-aecc-b613ca065c73 service nova] Creating event network-changed:e0695de7-055e-4c95-adf1-7ad9d8d04201 for instance e02a2f09-54d5-4788-800e-d2e7e3de4fff on hv-cinder-85032 Jul 21 08:38:38.274134 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-0cddb696-3581-4915-bcf6-3e0656174d85 req-bc213afd-98f9-4477-aecc-b613ca065c73 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055258 Jul 21 08:38:38.275130 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 466/936] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:39.209185 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-478d735e-97b9-43da-9760-56e805f608cf tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:39.209797 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-478d735e-97b9-43da-9760-56e805f608cf tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:39.217415 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478d735e-97b9-43da-9760-56e805f608cf tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:39.217860 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478d735e-97b9-43da-9760-56e805f608cf tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:39.218622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478d735e-97b9-43da-9760-56e805f608cf tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:39.219060 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478d735e-97b9-43da-9760-56e805f608cf tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:39.351563 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-478d735e-97b9-43da-9760-56e805f608cf tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:39.358978 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-478d735e-97b9-43da-9760-56e805f608cf tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1366 microversion: 2.1 time: 0.154842 Jul 21 08:38:39.359574 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 471/937] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:39 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:40.378177 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-724c6c55-1567-4571-ba64-27e606006e03 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:40.378852 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-724c6c55-1567-4571-ba64-27e606006e03 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:40.385063 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-724c6c55-1567-4571-ba64-27e606006e03 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:40.385492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-724c6c55-1567-4571-ba64-27e606006e03 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:40.386236 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-724c6c55-1567-4571-ba64-27e606006e03 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:40.386654 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-724c6c55-1567-4571-ba64-27e606006e03 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:40.521970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-724c6c55-1567-4571-ba64-27e606006e03 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:40.529388 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-724c6c55-1567-4571-ba64-27e606006e03 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1366 microversion: 2.1 time: 0.156663 Jul 21 08:38:40.529949 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 467/938] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:40 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:41.546121 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-33b58008-236e-456d-a10e-3255312331e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:41.546761 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-33b58008-236e-456d-a10e-3255312331e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:41.554804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33b58008-236e-456d-a10e-3255312331e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:41.555288 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33b58008-236e-456d-a10e-3255312331e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:41.556282 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33b58008-236e-456d-a10e-3255312331e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:41.556747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33b58008-236e-456d-a10e-3255312331e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:41.848357 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-33b58008-236e-456d-a10e-3255312331e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:41.855793 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-33b58008-236e-456d-a10e-3255312331e1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1366 microversion: 2.1 time: 0.313682 Jul 21 08:38:41.856401 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 472/939] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:41 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:42.873043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e0c5adc-5d6e-4141-b532-f965c2a5e950 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:42.873670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e0c5adc-5d6e-4141-b532-f965c2a5e950 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:42.882731 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e0c5adc-5d6e-4141-b532-f965c2a5e950 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:42.883253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e0c5adc-5d6e-4141-b532-f965c2a5e950 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:42.884066 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e0c5adc-5d6e-4141-b532-f965c2a5e950 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:42.884507 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e0c5adc-5d6e-4141-b532-f965c2a5e950 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:43.018707 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e0c5adc-5d6e-4141-b532-f965c2a5e950 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:43.026115 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e0c5adc-5d6e-4141-b532-f965c2a5e950 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1366 microversion: 2.1 time: 0.157298 Jul 21 08:38:43.026686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 468/940] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:42 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:43.462742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-01a6c724-e5f6-4cee-b48a-b5d27977c988 req-13a42680-d051-4e46-b096-f6ef1b442a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02a2f09-54d5-4788-800e-d2e7e3de4fff", "name": "network-vif-plugged", "status": "completed", "tag": "e0695de7-055e-4c95-adf1-7ad9d8d04201"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:43.471187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-01a6c724-e5f6-4cee-b48a-b5d27977c988 req-13a42680-d051-4e46-b096-f6ef1b442a6e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:43.471668 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-01a6c724-e5f6-4cee-b48a-b5d27977c988 req-13a42680-d051-4e46-b096-f6ef1b442a6e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:43.484017 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-01a6c724-e5f6-4cee-b48a-b5d27977c988 req-13a42680-d051-4e46-b096-f6ef1b442a6e service nova] Creating event network-vif-plugged:e0695de7-055e-4c95-adf1-7ad9d8d04201 for instance e02a2f09-54d5-4788-800e-d2e7e3de4fff on hv-cinder-85032 Jul 21 08:38:43.489916 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-01a6c724-e5f6-4cee-b48a-b5d27977c988 req-13a42680-d051-4e46-b096-f6ef1b442a6e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030813 Jul 21 08:38:43.490702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 473/941] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:44.042895 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-db794ed2-9a78-4c6e-af1f-77db0b6eb8ee tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:44.043458 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-db794ed2-9a78-4c6e-af1f-77db0b6eb8ee tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:44.049874 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db794ed2-9a78-4c6e-af1f-77db0b6eb8ee tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:44.050984 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db794ed2-9a78-4c6e-af1f-77db0b6eb8ee tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:44.051811 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db794ed2-9a78-4c6e-af1f-77db0b6eb8ee tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:44.052253 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db794ed2-9a78-4c6e-af1f-77db0b6eb8ee tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:44.178393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-db794ed2-9a78-4c6e-af1f-77db0b6eb8ee tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:44.185723 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-db794ed2-9a78-4c6e-af1f-77db0b6eb8ee tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1366 microversion: 2.1 time: 0.146769 Jul 21 08:38:44.186287 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 469/942] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:44 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:45.203216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-eabf581e-cf88-461b-8790-68102a3f6e87 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:45.204303 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eabf581e-cf88-461b-8790-68102a3f6e87 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:45.211774 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eabf581e-cf88-461b-8790-68102a3f6e87 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:45.212233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eabf581e-cf88-461b-8790-68102a3f6e87 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:45.213010 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eabf581e-cf88-461b-8790-68102a3f6e87 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:45.213484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eabf581e-cf88-461b-8790-68102a3f6e87 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:45.355579 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eabf581e-cf88-461b-8790-68102a3f6e87 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:45.363689 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-eabf581e-cf88-461b-8790-68102a3f6e87 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1366 microversion: 2.1 time: 0.164646 Jul 21 08:38:45.364269 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 474/943] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:45 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:45.945492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8bd7056e-72e2-49f9-b610-d5e8354b1a1c tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:45.946007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8bd7056e-72e2-49f9-b610-d5e8354b1a1c tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:45.948030 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-17a57b6a-92e5-4514-ae2d-c1682790144f req-b70f8f0c-347e-4b49-916b-76c5a26e69a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c09729-8625-497c-b28a-fb99327e229e", "tag": "4a25ac86-dd7b-49f3-a64b-cc34f393a6a4"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:45.948179 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:45.948835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:45.956259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:45.957918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8bd7056e-72e2-49f9-b610-d5e8354b1a1c tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:45.958542 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8bd7056e-72e2-49f9-b610-d5e8354b1a1c tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:45.959425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8bd7056e-72e2-49f9-b610-d5e8354b1a1c tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:45.959863 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8bd7056e-72e2-49f9-b610-d5e8354b1a1c tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:45.962906 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-17a57b6a-92e5-4514-ae2d-c1682790144f req-b70f8f0c-347e-4b49-916b-76c5a26e69a0 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:45.963378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-17a57b6a-92e5-4514-ae2d-c1682790144f req-b70f8f0c-347e-4b49-916b-76c5a26e69a0 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:45.975459 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-17a57b6a-92e5-4514-ae2d-c1682790144f req-b70f8f0c-347e-4b49-916b-76c5a26e69a0 service nova] Creating event network-changed:4a25ac86-dd7b-49f3-a64b-cc34f393a6a4 for instance 03c09729-8625-497c-b28a-fb99327e229e on hv-cinder-85032 Jul 21 08:38:45.980806 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-17a57b6a-92e5-4514-ae2d-c1682790144f req-b70f8f0c-347e-4b49-916b-76c5a26e69a0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036479 Jul 21 08:38:45.982092 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 475/944] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:45.989868 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8bd7056e-72e2-49f9-b610-d5e8354b1a1c tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:38:46.234303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8bd7056e-72e2-49f9-b610-d5e8354b1a1c tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "DELETE /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 204 len: 0 microversion: 2.1 time: 0.292586 Jul 21 08:38:46.235398 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 470/945] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:38:45 2022] DELETE /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:38:46.247056 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-03ef3a5d-c59c-493e-acb3-d1a2d4092b72 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:46.248377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-03ef3a5d-c59c-493e-acb3-d1a2d4092b72 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:46.263635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03ef3a5d-c59c-493e-acb3-d1a2d4092b72 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:46.264307 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03ef3a5d-c59c-493e-acb3-d1a2d4092b72 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:46.266158 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03ef3a5d-c59c-493e-acb3-d1a2d4092b72 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:46.266532 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03ef3a5d-c59c-493e-acb3-d1a2d4092b72 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:46.381953 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-072c6d3d-e606-40c4-a924-9ea477d7c364 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:46.382807 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-072c6d3d-e606-40c4-a924-9ea477d7c364 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:46.389494 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-072c6d3d-e606-40c4-a924-9ea477d7c364 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:46.389933 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-072c6d3d-e606-40c4-a924-9ea477d7c364 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:46.390738 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-072c6d3d-e606-40c4-a924-9ea477d7c364 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:46.391896 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-072c6d3d-e606-40c4-a924-9ea477d7c364 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:46.416403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-03ef3a5d-c59c-493e-acb3-d1a2d4092b72 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:46.426009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-03ef3a5d-c59c-493e-acb3-d1a2d4092b72 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.185096 Jul 21 08:38:46.427046 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 476/946] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:46 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:46.529535 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-072c6d3d-e606-40c4-a924-9ea477d7c364 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:46.537105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-072c6d3d-e606-40c4-a924-9ea477d7c364 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1557 microversion: 2.1 time: 0.160204 Jul 21 08:38:46.537672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 471/947] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:46 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:38:46.554058 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cbb1f7ca-1e3b-4a3c-858b-9520f08e52d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:46.554658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cbb1f7ca-1e3b-4a3c-858b-9520f08e52d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:46.561377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cbb1f7ca-1e3b-4a3c-858b-9520f08e52d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:46.561830 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cbb1f7ca-1e3b-4a3c-858b-9520f08e52d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:46.562615 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cbb1f7ca-1e3b-4a3c-858b-9520f08e52d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:46.563067 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cbb1f7ca-1e3b-4a3c-858b-9520f08e52d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:46.642196 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cbb1f7ca-1e3b-4a3c-858b-9520f08e52d0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092704 Jul 21 08:38:46.642793 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 477/948] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 21 08:38:46 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:38:47.445371 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11b46d04-cb35-49c0-992a-c071231e9629 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:47.446718 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-11b46d04-cb35-49c0-992a-c071231e9629 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:47.453337 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b46d04-cb35-49c0-992a-c071231e9629 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:47.454010 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b46d04-cb35-49c0-992a-c071231e9629 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:47.454780 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b46d04-cb35-49c0-992a-c071231e9629 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:47.455207 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11b46d04-cb35-49c0-992a-c071231e9629 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:47.605248 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-53760753-ce41-4eb5-aeae-d038fb5f7b9d req-489af4b0-0a59-4acc-b676-4ba95c580123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02a2f09-54d5-4788-800e-d2e7e3de4fff", "tag": "e0695de7-055e-4c95-adf1-7ad9d8d04201"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:47.608823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:47.614511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-53760753-ce41-4eb5-aeae-d038fb5f7b9d req-489af4b0-0a59-4acc-b676-4ba95c580123 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:47.614943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-53760753-ce41-4eb5-aeae-d038fb5f7b9d req-489af4b0-0a59-4acc-b676-4ba95c580123 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:47.626986 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-53760753-ce41-4eb5-aeae-d038fb5f7b9d req-489af4b0-0a59-4acc-b676-4ba95c580123 service nova] Creating event network-changed:e0695de7-055e-4c95-adf1-7ad9d8d04201 for instance e02a2f09-54d5-4788-800e-d2e7e3de4fff on hv-cinder-85032 Jul 21 08:38:47.632924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-53760753-ce41-4eb5-aeae-d038fb5f7b9d req-489af4b0-0a59-4acc-b676-4ba95c580123 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031949 Jul 21 08:38:47.634009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 478/949] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:38:47.689019 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-11b46d04-cb35-49c0-992a-c071231e9629 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:47.697465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-11b46d04-cb35-49c0-992a-c071231e9629 tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1568 microversion: 2.1 time: 0.256376 Jul 21 08:38:47.698047 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 472/950] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:47 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:38:48.699692 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a1e8ae88-6e70-41af-b22c-b04cc63b6706 req-4bad8e13-73d2-40f4-80a8-846cfaa3d58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c09729-8625-497c-b28a-fb99327e229e", "name": "network-vif-deleted", "tag": "4a25ac86-dd7b-49f3-a64b-cc34f393a6a4"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:38:48.711280 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a1e8ae88-6e70-41af-b22c-b04cc63b6706 req-4bad8e13-73d2-40f4-80a8-846cfaa3d58e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:48.711750 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a1e8ae88-6e70-41af-b22c-b04cc63b6706 req-4bad8e13-73d2-40f4-80a8-846cfaa3d58e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:48.716073 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-460e39e5-8626-43f2-b909-a76035c147dd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:48.716683 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-460e39e5-8626-43f2-b909-a76035c147dd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:48.723878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-460e39e5-8626-43f2-b909-a76035c147dd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:48.724835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-460e39e5-8626-43f2-b909-a76035c147dd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:48.725619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-460e39e5-8626-43f2-b909-a76035c147dd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:48.725923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a1e8ae88-6e70-41af-b22c-b04cc63b6706 req-4bad8e13-73d2-40f4-80a8-846cfaa3d58e service nova] Creating event network-vif-deleted:4a25ac86-dd7b-49f3-a64b-cc34f393a6a4 for instance 03c09729-8625-497c-b28a-fb99327e229e on hv-cinder-85032 Jul 21 08:38:48.726087 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-460e39e5-8626-43f2-b909-a76035c147dd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:48.731084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a1e8ae88-6e70-41af-b22c-b04cc63b6706 req-4bad8e13-73d2-40f4-80a8-846cfaa3d58e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036212 Jul 21 08:38:48.731716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 479/951] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:38:48.795465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-460e39e5-8626-43f2-b909-a76035c147dd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45688a2eafb840e9b2b4c56bbee69375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb36757791d463e92faf5dbaa0ff13a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:38:48.802980 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-460e39e5-8626-43f2-b909-a76035c147dd tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 200 len: 1218 microversion: 2.1 time: 0.091257 Jul 21 08:38:48.803571 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 473/952] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:48 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:38:49.820384 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:49.820998 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] [instance: 03c09729-8625-497c-b28a-fb99327e229e] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:38:49.827843 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:49.828293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:49.829053 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:38:49.829492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:38:49.843943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] HTTP exception thrown: Instance 03c09729-8625-497c-b28a-fb99327e229e could not be found. Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Request method failure captured: Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e HTTP/1.1 Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2Q8zlQvrXBzcTQG07mTRlTgQv6g2-LFxMFSwYxOUnOmJxKVZv0rMwDXcT8pbkXtVOmcz83Oz1A4v3GGIwuskzMjzp3vM4G95AfQJONvqbHVq420Eifr_J1IOmtN_bOdhZqZ28vNXWz3af0geYri6fVJEB0a7Sh8v9PAzfkUh4sg9ojk Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: ccb36757791d463e92faf5dbaa0ff13a Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestShelveInstance-1171415305 Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:38:49.845539 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ccb36757791d463e92faf5dbaa0ff13a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ccb36757791d463e92faf5dbaa0ff13a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ccb36757791d463e92faf5dbaa0ff13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ccb36757791d463e92faf5dbaa0ff13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestShelveInstance-1171415305 Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ccb36757791d463e92faf5dbaa0ff13a Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestShelveInstance-1171415305 Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-TestShelveInstance-1171415305-project Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 45688a2eafb840e9b2b4c56bbee69375 Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestShelveInstance-1171415305-project Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 03c09729-8625-497c-b28a-fb99327e229e could not be found. Jul 21 08:38:49.847742 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '03c09729-8625-497c-b28a-fb99327e229e'} Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c09729-8625-497c-b28a-fb99327e229e could not be found. Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:38:49.848743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c09729-8625-497c-b28a-fb99327e229e could not be found. Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c09729-8625-497c-b28a-fb99327e229e could not be found. Jul 21 08:38:49.850311 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:38:49.851739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Returning 404 to user: Instance 03c09729-8625-497c-b28a-fb99327e229e could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:38:49.851739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-65850afd-be4d-4362-a166-d1681ab8266f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e" status: 404 len: 111 microversion: 2.1 time: 0.030845 Jul 21 08:38:49.851739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 480/953] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:38:49 2022] GET /compute/v2.1/servers/03c09729-8625-497c-b28a-fb99327e229e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:38:50.012025 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad4cf89d-67f8-48f7-88d3-6e7bacb40d4f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] Calling method '.version_select at 0x7f65c0b50a60>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:38:50.030028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad4cf89d-67f8-48f7-88d3-6e7bacb40d4f tempest-TestShelveInstance-1171415305 tempest-TestShelveInstance-1171415305-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-853433119" status: 202 len: 0 microversion: 2.1 time: 0.022496 Jul 21 08:38:50.030924 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 474/954] 10.222.0.47 () {58 vars in 1250 bytes} [Thu Jul 21 08:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-853433119 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:39:05.511312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d039f53c-e737-42d2-8ca8-38bc2a2651f2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:05.511847 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d039f53c-e737-42d2-8ca8-38bc2a2651f2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:05.514063 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=5 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:05.514917 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=38 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:05.521622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d039f53c-e737-42d2-8ca8-38bc2a2651f2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:05.522096 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d039f53c-e737-42d2-8ca8-38bc2a2651f2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:05.522882 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d039f53c-e737-42d2-8ca8-38bc2a2651f2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:05.523312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d039f53c-e737-42d2-8ca8-38bc2a2651f2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:05.546034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d039f53c-e737-42d2-8ca8-38bc2a2651f2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/ips" status: 200 len: 146 microversion: 2.1 time: 0.038540 Jul 21 08:39:05.546590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 481/955] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:39:05 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:39:07.994835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:07.995639 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:08.000173 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71fabd0b-ed58-4666-8ff7-d8fa39fb245c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1939c9bb-b167-496e-b1fc-7e4f87f30cf1"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:08.001221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71fabd0b-ed58-4666-8ff7-d8fa39fb245c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:08.010126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71fabd0b-ed58-4666-8ff7-d8fa39fb245c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:08.010704 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71fabd0b-ed58-4666-8ff7-d8fa39fb245c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:08.011507 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71fabd0b-ed58-4666-8ff7-d8fa39fb245c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:08.011946 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71fabd0b-ed58-4666-8ff7-d8fa39fb245c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:08.259242 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71fabd0b-ed58-4666-8ff7-d8fa39fb245c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265589 Jul 21 08:39:08.259942 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 475/956] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:39:07 2022] POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:39:14.696115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-692629d4-ee89-43f4-939f-3265532ab64d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:14.702768 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-692629d4-ee89-43f4-939f-3265532ab64d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:14.703267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-692629d4-ee89-43f4-939f-3265532ab64d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:14.775618 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-692629d4-ee89-43f4-939f-3265532ab64d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Going to try to stop instance {{(pid=117950) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 08:39:14.821098 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-692629d4-ee89-43f4-939f-3265532ab64d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/action" status: 202 len: 0 microversion: 2.1 time: 0.128737 Jul 21 08:39:14.821712 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 482/957] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:39:14 2022] POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:39:14.831795 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d2ff6bb9-2574-4621-a698-762b45142e7e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:14.831795 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d2ff6bb9-2574-4621-a698-762b45142e7e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:14.838773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2ff6bb9-2574-4621-a698-762b45142e7e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:14.839181 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2ff6bb9-2574-4621-a698-762b45142e7e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:14.840051 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2ff6bb9-2574-4621-a698-762b45142e7e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:14.840488 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d2ff6bb9-2574-4621-a698-762b45142e7e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:14.974518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d2ff6bb9-2574-4621-a698-762b45142e7e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:14.982367 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d2ff6bb9-2574-4621-a698-762b45142e7e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.156118 Jul 21 08:39:14.982930 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 476/958] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:14 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:16.001013 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c50857c3-5782-4528-9f27-cc8a19b092ad tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:16.001747 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c50857c3-5782-4528-9f27-cc8a19b092ad tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:16.008193 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c50857c3-5782-4528-9f27-cc8a19b092ad tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:16.008633 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c50857c3-5782-4528-9f27-cc8a19b092ad tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:16.009397 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c50857c3-5782-4528-9f27-cc8a19b092ad tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:16.009839 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c50857c3-5782-4528-9f27-cc8a19b092ad tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:16.150760 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c50857c3-5782-4528-9f27-cc8a19b092ad tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:16.158825 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c50857c3-5782-4528-9f27-cc8a19b092ad tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.162650 Jul 21 08:39:16.159423 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 483/959] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:15 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:17.176438 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-baa3b6e3-87ac-4157-985b-36d80e9470ba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:17.177532 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-baa3b6e3-87ac-4157-985b-36d80e9470ba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:17.184024 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baa3b6e3-87ac-4157-985b-36d80e9470ba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:17.184470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baa3b6e3-87ac-4157-985b-36d80e9470ba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:17.185239 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baa3b6e3-87ac-4157-985b-36d80e9470ba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:17.185672 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-baa3b6e3-87ac-4157-985b-36d80e9470ba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:17.313743 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-baa3b6e3-87ac-4157-985b-36d80e9470ba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:17.322310 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-baa3b6e3-87ac-4157-985b-36d80e9470ba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.149782 Jul 21 08:39:17.322881 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 477/960] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:17 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:18.339977 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9e5e3da9-0ad1-4834-8cdd-592abe5fecee tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:18.340586 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9e5e3da9-0ad1-4834-8cdd-592abe5fecee tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:18.347238 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e5e3da9-0ad1-4834-8cdd-592abe5fecee tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:18.347719 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e5e3da9-0ad1-4834-8cdd-592abe5fecee tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:18.348487 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e5e3da9-0ad1-4834-8cdd-592abe5fecee tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:18.348927 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e5e3da9-0ad1-4834-8cdd-592abe5fecee tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:18.475495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9e5e3da9-0ad1-4834-8cdd-592abe5fecee tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:18.483591 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9e5e3da9-0ad1-4834-8cdd-592abe5fecee tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.147426 Jul 21 08:39:18.484166 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 484/961] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:18 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:19.500710 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26ab3761-28ca-4af6-b523-b3ab52db38e9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:19.501323 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26ab3761-28ca-4af6-b523-b3ab52db38e9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:19.508544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26ab3761-28ca-4af6-b523-b3ab52db38e9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:19.508991 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26ab3761-28ca-4af6-b523-b3ab52db38e9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:19.509770 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26ab3761-28ca-4af6-b523-b3ab52db38e9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:19.510207 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26ab3761-28ca-4af6-b523-b3ab52db38e9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:19.643798 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26ab3761-28ca-4af6-b523-b3ab52db38e9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:19.652433 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26ab3761-28ca-4af6-b523-b3ab52db38e9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.155631 Jul 21 08:39:19.653005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 478/962] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:19 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:20.669656 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-27c541a2-332c-4772-9579-0e9902fb440b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:20.670262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-27c541a2-332c-4772-9579-0e9902fb440b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:20.676930 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-27c541a2-332c-4772-9579-0e9902fb440b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:20.677377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-27c541a2-332c-4772-9579-0e9902fb440b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:20.678140 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-27c541a2-332c-4772-9579-0e9902fb440b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:20.678577 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-27c541a2-332c-4772-9579-0e9902fb440b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:20.809082 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-27c541a2-332c-4772-9579-0e9902fb440b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:20.817066 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-27c541a2-332c-4772-9579-0e9902fb440b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.151293 Jul 21 08:39:20.817634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 485/963] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:20 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:21.837420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1c1fef46-ca99-4ba7-9b5d-b9bcd8162430 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:21.837956 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1c1fef46-ca99-4ba7-9b5d-b9bcd8162430 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:21.844345 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c1fef46-ca99-4ba7-9b5d-b9bcd8162430 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:21.844787 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c1fef46-ca99-4ba7-9b5d-b9bcd8162430 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:21.845547 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c1fef46-ca99-4ba7-9b5d-b9bcd8162430 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:21.845978 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c1fef46-ca99-4ba7-9b5d-b9bcd8162430 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:21.975266 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1c1fef46-ca99-4ba7-9b5d-b9bcd8162430 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:21.984104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1c1fef46-ca99-4ba7-9b5d-b9bcd8162430 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.152090 Jul 21 08:39:21.984687 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 479/964] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:21 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:23.001084 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4b3b1035-b43b-4a45-8b61-5f1a1f5a2d61 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:23.001700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4b3b1035-b43b-4a45-8b61-5f1a1f5a2d61 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:23.008413 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b3b1035-b43b-4a45-8b61-5f1a1f5a2d61 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:23.008862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b3b1035-b43b-4a45-8b61-5f1a1f5a2d61 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:23.009620 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b3b1035-b43b-4a45-8b61-5f1a1f5a2d61 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:23.010057 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b3b1035-b43b-4a45-8b61-5f1a1f5a2d61 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:23.141107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4b3b1035-b43b-4a45-8b61-5f1a1f5a2d61 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:23.149710 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4b3b1035-b43b-4a45-8b61-5f1a1f5a2d61 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.152454 Jul 21 08:39:23.150272 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 486/965] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:22 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:23.651425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e03d3ba3-9ca3-43c6-b5bb-c4088e2ebc36 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:23.651994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e03d3ba3-9ca3-43c6-b5bb-c4088e2ebc36 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:23.658382 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e03d3ba3-9ca3-43c6-b5bb-c4088e2ebc36 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:23.658831 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e03d3ba3-9ca3-43c6-b5bb-c4088e2ebc36 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:23.659622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e03d3ba3-9ca3-43c6-b5bb-c4088e2ebc36 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:23.660057 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e03d3ba3-9ca3-43c6-b5bb-c4088e2ebc36 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:23.682392 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e03d3ba3-9ca3-43c6-b5bb-c4088e2ebc36 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/ips" status: 200 len: 150 microversion: 2.1 time: 0.035711 Jul 21 08:39:23.682943 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 480/966] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:39:23 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:39:24.166846 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb8828b2-5fd8-4c13-b59b-490bc41fd5e0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:24.167412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cb8828b2-5fd8-4c13-b59b-490bc41fd5e0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:24.173441 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb8828b2-5fd8-4c13-b59b-490bc41fd5e0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:24.173889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb8828b2-5fd8-4c13-b59b-490bc41fd5e0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:24.174651 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb8828b2-5fd8-4c13-b59b-490bc41fd5e0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:24.175088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb8828b2-5fd8-4c13-b59b-490bc41fd5e0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:24.307484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cb8828b2-5fd8-4c13-b59b-490bc41fd5e0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:24.315443 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cb8828b2-5fd8-4c13-b59b-490bc41fd5e0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.152704 Jul 21 08:39:24.316007 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 487/967] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:24 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:25.009216 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3f595ea4-8789-4d0f-9c91-f0e6ca9eb009 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cac11445-23d7-4e6f-afc3-7315f9ab97c8"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:25.010378 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3f595ea4-8789-4d0f-9c91-f0e6ca9eb009 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:25.016804 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f595ea4-8789-4d0f-9c91-f0e6ca9eb009 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:25.017251 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f595ea4-8789-4d0f-9c91-f0e6ca9eb009 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:25.018013 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f595ea4-8789-4d0f-9c91-f0e6ca9eb009 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:25.018443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f595ea4-8789-4d0f-9c91-f0e6ca9eb009 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:25.270321 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3f595ea4-8789-4d0f-9c91-f0e6ca9eb009 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264909 Jul 21 08:39:25.271000 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 481/968] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:39:25 2022] POST /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:39:25.335653 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d0990f79-f750-4b14-99f5-8cf9d9dd5e1e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:25.336383 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d0990f79-f750-4b14-99f5-8cf9d9dd5e1e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:25.343797 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0990f79-f750-4b14-99f5-8cf9d9dd5e1e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:25.344519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0990f79-f750-4b14-99f5-8cf9d9dd5e1e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:25.345579 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0990f79-f750-4b14-99f5-8cf9d9dd5e1e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:25.346222 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0990f79-f750-4b14-99f5-8cf9d9dd5e1e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:25.490721 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d0990f79-f750-4b14-99f5-8cf9d9dd5e1e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:25.498824 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d0990f79-f750-4b14-99f5-8cf9d9dd5e1e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.168243 Jul 21 08:39:25.499310 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 488/969] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:25 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:26.516273 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0d798e6-2a85-4144-827e-7762a77f1542 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:26.516968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0d798e6-2a85-4144-827e-7762a77f1542 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:26.523503 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0d798e6-2a85-4144-827e-7762a77f1542 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:26.523945 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0d798e6-2a85-4144-827e-7762a77f1542 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:26.524698 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0d798e6-2a85-4144-827e-7762a77f1542 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:26.525119 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0d798e6-2a85-4144-827e-7762a77f1542 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:26.660559 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d0d798e6-2a85-4144-827e-7762a77f1542 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:26.669059 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0d798e6-2a85-4144-827e-7762a77f1542 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.157443 Jul 21 08:39:26.669619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 482/970] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:26 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:27.686012 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dbda818c-2058-4175-8f50-ec5f6715fda0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:27.686626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dbda818c-2058-4175-8f50-ec5f6715fda0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:27.693158 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbda818c-2058-4175-8f50-ec5f6715fda0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:27.694260 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbda818c-2058-4175-8f50-ec5f6715fda0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:27.694992 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbda818c-2058-4175-8f50-ec5f6715fda0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:27.695461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbda818c-2058-4175-8f50-ec5f6715fda0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:27.821510 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dbda818c-2058-4175-8f50-ec5f6715fda0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:27.829445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dbda818c-2058-4175-8f50-ec5f6715fda0 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.147273 Jul 21 08:39:27.830014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 489/971] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:27 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:28.847932 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fe17e99c-9802-435a-bcf1-8a7eb0267f81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:28.848492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fe17e99c-9802-435a-bcf1-8a7eb0267f81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:28.855141 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe17e99c-9802-435a-bcf1-8a7eb0267f81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:28.855617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe17e99c-9802-435a-bcf1-8a7eb0267f81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:28.856394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe17e99c-9802-435a-bcf1-8a7eb0267f81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:28.856825 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe17e99c-9802-435a-bcf1-8a7eb0267f81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:28.988397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe17e99c-9802-435a-bcf1-8a7eb0267f81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:28.996337 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fe17e99c-9802-435a-bcf1-8a7eb0267f81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.152425 Jul 21 08:39:28.996903 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 483/972] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:28 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:30.014088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f48c2df2-0bb7-41eb-a778-09000245f9b3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:30.014888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f48c2df2-0bb7-41eb-a778-09000245f9b3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:30.021871 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f48c2df2-0bb7-41eb-a778-09000245f9b3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:30.022329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f48c2df2-0bb7-41eb-a778-09000245f9b3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:30.023102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f48c2df2-0bb7-41eb-a778-09000245f9b3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:30.023572 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f48c2df2-0bb7-41eb-a778-09000245f9b3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:30.160569 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f48c2df2-0bb7-41eb-a778-09000245f9b3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:30.168760 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f48c2df2-0bb7-41eb-a778-09000245f9b3 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1722 microversion: 2.1 time: 0.158458 Jul 21 08:39:30.169348 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 490/973] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:30 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:31.186099 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c79b3054-91ad-4724-b56c-da42f11757a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:31.186681 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c79b3054-91ad-4724-b56c-da42f11757a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:31.193341 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c79b3054-91ad-4724-b56c-da42f11757a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.193787 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c79b3054-91ad-4724-b56c-da42f11757a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.194537 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c79b3054-91ad-4724-b56c-da42f11757a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.194960 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c79b3054-91ad-4724-b56c-da42f11757a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.329318 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c79b3054-91ad-4724-b56c-da42f11757a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:31.337486 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c79b3054-91ad-4724-b56c-da42f11757a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1699 microversion: 2.1 time: 0.155296 Jul 21 08:39:31.338086 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 484/974] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:31 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:31.353631 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3c39dc14-f7d6-42fd-b5f5-cba81050d601 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:31.360108 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3c39dc14-f7d6-42fd-b5f5-cba81050d601 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.360552 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3c39dc14-f7d6-42fd-b5f5-cba81050d601 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.382881 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3c39dc14-f7d6-42fd-b5f5-cba81050d601 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Going to try to start instance {{(pid=117950) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 08:39:31.422186 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3c39dc14-f7d6-42fd-b5f5-cba81050d601 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/action" status: 202 len: 0 microversion: 2.1 time: 0.072280 Jul 21 08:39:31.422794 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 491/975] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:39:31 2022] POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:39:31.431416 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7958b38-85d3-4330-9062-dbf147ef239b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:31.432028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7958b38-85d3-4330-9062-dbf147ef239b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:31.437984 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7958b38-85d3-4330-9062-dbf147ef239b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.438370 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7958b38-85d3-4330-9062-dbf147ef239b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.439132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7958b38-85d3-4330-9062-dbf147ef239b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.439588 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7958b38-85d3-4330-9062-dbf147ef239b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.632269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7958b38-85d3-4330-9062-dbf147ef239b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:31.640502 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7958b38-85d3-4330-9062-dbf147ef239b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1708 microversion: 2.1 time: 0.213352 Jul 21 08:39:31.642279 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 485/976] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:31 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1708 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:31.731203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cac11445-23d7-4e6f-afc3-7315f9ab97c8"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:31.732454 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:31.738548 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.739093 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.739780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.740799 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.821800 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Invalid volume: volume cac11445-23d7-4e6f-afc3-7315f9ab97c8 is already attached to instances: e02a2f09-54d5-4788-800e-d2e7e3de4fff Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: POST /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments HTTP/1.1 Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 74 Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:39:31.823700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {"volumeAttachment": {"volumeId": "cac11445-23d7-4e6f-afc3-7315f9ab97c8"}} Jul 21 08:39:31.825424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Invalid volume: volume cac11445-23d7-4e6f-afc3-7315f9ab97c8 is already attached to instances: e02a2f09-54d5-4788-800e-d2e7e3de4fff Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'server_id': 'e02a2f09-54d5-4788-800e-d2e7e3de4fff', 'body': {'volumeAttachment': {'volumeId': 'cac11445-23d7-4e6f-afc3-7315f9ab97c8'}}} Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cac11445-23d7-4e6f-afc3-7315f9ab97c8 is already attached to instances: e02a2f09-54d5-4788-800e-d2e7e3de4fff Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:39:31.826329 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cac11445-23d7-4e6f-afc3-7315f9ab97c8 is already attached to instances: e02a2f09-54d5-4788-800e-d2e7e3de4fff Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:39:31.827892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:39:31.829377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:39:31.829377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:39:31.829377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:39:31.829377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cac11445-23d7-4e6f-afc3-7315f9ab97c8 is already attached to instances: e02a2f09-54d5-4788-800e-d2e7e3de4fff Jul 21 08:39:31.829377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:39:31.829377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 400 to user: Invalid volume: volume cac11445-23d7-4e6f-afc3-7315f9ab97c8 is already attached to instances: e02a2f09-54d5-4788-800e-d2e7e3de4fff {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:39:31.829377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-08ffe5f7-c3dd-4718-819a-54a328f81270 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098370 Jul 21 08:39:31.829377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 492/977] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:39:31 2022] POST /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 08:39:31.901891 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-decb6e35-44f1-42b8-90c1-16dfd5344b17 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:31.902382 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-decb6e35-44f1-42b8-90c1-16dfd5344b17 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:31.908485 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-decb6e35-44f1-42b8-90c1-16dfd5344b17 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.908918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-decb6e35-44f1-42b8-90c1-16dfd5344b17 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.909677 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-decb6e35-44f1-42b8-90c1-16dfd5344b17 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:31.910103 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-decb6e35-44f1-42b8-90c1-16dfd5344b17 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:31.991021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-decb6e35-44f1-42b8-90c1-16dfd5344b17 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lazy-loading 'services' on Instance uuid e02a2f09-54d5-4788-800e-d2e7e3de4fff {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:39:32.064582 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-decb6e35-44f1-42b8-90c1-16dfd5344b17 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments/cac11445-23d7-4e6f-afc3-7315f9ab97c8" status: 202 len: 0 microversion: 2.1 time: 0.166565 Jul 21 08:39:32.065220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 486/978] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:39:31 2022] DELETE /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments/cac11445-23d7-4e6f-afc3-7315f9ab97c8 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 08:39:32.075066 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fe5d21a5-986b-492e-8a22-a6f5d9b9f821 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:32.076025 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fe5d21a5-986b-492e-8a22-a6f5d9b9f821 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:32.084612 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe5d21a5-986b-492e-8a22-a6f5d9b9f821 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:32.085730 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe5d21a5-986b-492e-8a22-a6f5d9b9f821 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:32.087419 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe5d21a5-986b-492e-8a22-a6f5d9b9f821 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:32.087865 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe5d21a5-986b-492e-8a22-a6f5d9b9f821 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:32.120483 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fe5d21a5-986b-492e-8a22-a6f5d9b9f821 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050202 Jul 21 08:39:32.121068 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 493/979] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:39:32 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:39:32.659298 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f9939ef-5646-4d75-875e-23fd24ae8124 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:32.660012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f9939ef-5646-4d75-875e-23fd24ae8124 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:32.666802 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f9939ef-5646-4d75-875e-23fd24ae8124 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:32.667247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f9939ef-5646-4d75-875e-23fd24ae8124 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:32.668028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f9939ef-5646-4d75-875e-23fd24ae8124 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:32.668456 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f9939ef-5646-4d75-875e-23fd24ae8124 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:32.796670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f9939ef-5646-4d75-875e-23fd24ae8124 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:32.804600 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f9939ef-5646-4d75-875e-23fd24ae8124 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1708 microversion: 2.1 time: 0.150004 Jul 21 08:39:32.805163 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 487/980] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:32 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:33.133283 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e55a3899-42bc-4ff9-9d62-52489b65008a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:33.134419 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e55a3899-42bc-4ff9-9d62-52489b65008a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:33.141096 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e55a3899-42bc-4ff9-9d62-52489b65008a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:33.141544 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e55a3899-42bc-4ff9-9d62-52489b65008a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:33.142308 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e55a3899-42bc-4ff9-9d62-52489b65008a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:33.142743 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e55a3899-42bc-4ff9-9d62-52489b65008a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:33.171264 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e55a3899-42bc-4ff9-9d62-52489b65008a tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042618 Jul 21 08:39:33.171845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 494/981] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:39:33 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:39:33.822414 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a43f01fc-9dfe-4779-ae70-2031037d63c6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:33.823029 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a43f01fc-9dfe-4779-ae70-2031037d63c6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:33.829515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a43f01fc-9dfe-4779-ae70-2031037d63c6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:33.829953 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a43f01fc-9dfe-4779-ae70-2031037d63c6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:33.830717 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a43f01fc-9dfe-4779-ae70-2031037d63c6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:33.831152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a43f01fc-9dfe-4779-ae70-2031037d63c6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:33.848609 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:33.964952 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a43f01fc-9dfe-4779-ae70-2031037d63c6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:33.973094 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a43f01fc-9dfe-4779-ae70-2031037d63c6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1712 microversion: 2.1 time: 0.155111 Jul 21 08:39:33.973707 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 488/982] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:33 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1712 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:34.183377 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cf4cc335-d8bb-45e6-92c6-7e0c50b45ece tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:34.184305 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cf4cc335-d8bb-45e6-92c6-7e0c50b45ece tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:34.190733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf4cc335-d8bb-45e6-92c6-7e0c50b45ece tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:34.191182 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf4cc335-d8bb-45e6-92c6-7e0c50b45ece tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:34.191975 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf4cc335-d8bb-45e6-92c6-7e0c50b45ece tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:34.192402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf4cc335-d8bb-45e6-92c6-7e0c50b45ece tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:34.216371 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:34.221339 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cf4cc335-d8bb-45e6-92c6-7e0c50b45ece tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041905 Jul 21 08:39:34.221893 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 495/983] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:39:34 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:39:34.281234 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ece363cc-e4c2-4e59-b23b-025067235a45 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:34.281751 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ece363cc-e4c2-4e59-b23b-025067235a45 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:34.289296 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ece363cc-e4c2-4e59-b23b-025067235a45 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:34.289740 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ece363cc-e4c2-4e59-b23b-025067235a45 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:34.290508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ece363cc-e4c2-4e59-b23b-025067235a45 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:34.290945 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ece363cc-e4c2-4e59-b23b-025067235a45 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:34.317181 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ece363cc-e4c2-4e59-b23b-025067235a45 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:39:34.390839 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ece363cc-e4c2-4e59-b23b-025067235a45 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 204 len: 0 microversion: 2.1 time: 0.113070 Jul 21 08:39:34.391712 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 489/984] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:39:34 2022] DELETE /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:39:34.400915 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-197f85bd-a140-430b-858b-5ba8fddf8d27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:34.401531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-197f85bd-a140-430b-858b-5ba8fddf8d27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:34.408360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-197f85bd-a140-430b-858b-5ba8fddf8d27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:34.408809 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-197f85bd-a140-430b-858b-5ba8fddf8d27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:34.409571 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-197f85bd-a140-430b-858b-5ba8fddf8d27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:34.410004 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-197f85bd-a140-430b-858b-5ba8fddf8d27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:34.539154 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-197f85bd-a140-430b-858b-5ba8fddf8d27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:34.546675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-197f85bd-a140-430b-858b-5ba8fddf8d27 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1681 microversion: 2.1 time: 0.150461 Jul 21 08:39:34.547243 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 496/985] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:34 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:35.565594 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b6041ec-3bf7-4d0d-b7e2-6631e17716c3 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:35.566429 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6b6041ec-3bf7-4d0d-b7e2-6631e17716c3 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:35.573999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b6041ec-3bf7-4d0d-b7e2-6631e17716c3 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:35.574438 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b6041ec-3bf7-4d0d-b7e2-6631e17716c3 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:35.575203 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b6041ec-3bf7-4d0d-b7e2-6631e17716c3 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:35.575660 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b6041ec-3bf7-4d0d-b7e2-6631e17716c3 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:35.703619 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6b6041ec-3bf7-4d0d-b7e2-6631e17716c3 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:35.711706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6b6041ec-3bf7-4d0d-b7e2-6631e17716c3 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1681 microversion: 2.1 time: 0.150740 Jul 21 08:39:35.712280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 490/986] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:35 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:39:36.728640 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b509c452-2b74-4c3d-a1cd-cd917d6fe1f0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:36.729497 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b509c452-2b74-4c3d-a1cd-cd917d6fe1f0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:36.732214 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=33 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:36.738239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b509c452-2b74-4c3d-a1cd-cd917d6fe1f0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:36.738751 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b509c452-2b74-4c3d-a1cd-cd917d6fe1f0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:36.739683 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b509c452-2b74-4c3d-a1cd-cd917d6fe1f0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:36.740227 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b509c452-2b74-4c3d-a1cd-cd917d6fe1f0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:36.751193 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-20c5061e-3c5c-410a-8abe-f6ae294971b9 req-07c45600-6ec3-4531-8515-cbbae72a96e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02a2f09-54d5-4788-800e-d2e7e3de4fff", "name": "network-vif-deleted", "tag": "e0695de7-055e-4c95-adf1-7ad9d8d04201"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:36.761243 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-20c5061e-3c5c-410a-8abe-f6ae294971b9 req-07c45600-6ec3-4531-8515-cbbae72a96e5 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:36.761664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-20c5061e-3c5c-410a-8abe-f6ae294971b9 req-07c45600-6ec3-4531-8515-cbbae72a96e5 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:36.774571 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-20c5061e-3c5c-410a-8abe-f6ae294971b9 req-07c45600-6ec3-4531-8515-cbbae72a96e5 service nova] Creating event network-vif-deleted:e0695de7-055e-4c95-adf1-7ad9d8d04201 for instance e02a2f09-54d5-4788-800e-d2e7e3de4fff on hv-cinder-85032 Jul 21 08:39:36.780146 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-20c5061e-3c5c-410a-8abe-f6ae294971b9 req-07c45600-6ec3-4531-8515-cbbae72a96e5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032415 Jul 21 08:39:36.781100 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 491/987] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:39:36.827263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b509c452-2b74-4c3d-a1cd-cd917d6fe1f0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:36.840233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b509c452-2b74-4c3d-a1cd-cd917d6fe1f0 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 200 len: 1613 microversion: 2.1 time: 0.115785 Jul 21 08:39:36.840931 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 497/988] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:36 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:37.858303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:37.859100 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:37.866064 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:37.866506 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:37.867479 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:37.867920 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:37.884994 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff HTTP/1.1 Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:39:37.886662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:39:37.889095 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'e02a2f09-54d5-4788-800e-d2e7e3de4fff'} Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:39:37.890178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:39:37.892068 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:39:37.894364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:39:37.894364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1202d252-5471-4797-956f-2cb5c19b7974 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 404 len: 111 microversion: 2.1 time: 0.034552 Jul 21 08:39:37.894364 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 492/989] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:37 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:39:37.897897 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-826157b1-76ae-4f83-8b90-bb6227f4102c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '.version_select at 0x7f65bc2898b0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:37.916035 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-826157b1-76ae-4f83-8b90-bb6227f4102c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179103194" status: 202 len: 0 microversion: 2.1 time: 0.021992 Jul 21 08:39:37.916607 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 498/990] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 21 08:39:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179103194 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:39:38.535045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c94e2d0-8467-4221-8cee-a77de34aa7a6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: .version_select at 0x7f65bc7e23a0>, body: {"keypair": {"name": "tempest-keypair-1690557687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcK5JCKj9G8mJGwqgWAgdSoZIjwknTo2kLhwapdIqpbmkU4q/DUwNR5qjS7HWd5EtMkbCzfvFRtRYO10Cm80SCx6t7A1nVNDhOYPyINGUYMg/ABaQn2euLykZw54revgQ=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:38.539215 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:38.553722 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-7c94e2d0-8467-4221-8cee-a77de34aa7a6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for project ca704726a8064214b0507190fe51650f. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:39:38.557735 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-7c94e2d0-8467-4221-8cee-a77de34aa7a6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for user 7baa0b2ddca4431b8d006873ca90ab2c and project ca704726a8064214b0507190fe51650f. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:39:38.580032 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c94e2d0-8467-4221-8cee-a77de34aa7a6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049120 Jul 21 08:39:38.580640 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 493/991] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:39:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:39:39.838145 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1348812568", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84a3c360-33c3-4fe6-9eae-ca3228ce08c7"}], "security_groups": [{"name": "tempest-securitygroup--1922184970"}], "key_name": "tempest-keypair-1690557687", "user_data": "}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:39.940953 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] validate_networks() for [('84a3c360-33c3-4fe6-9eae-ca3228ce08c7', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:39:40.306094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:39:40.306528 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:39:40.307002 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:39:40.307448 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:39:40.307858 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:39:40.316726 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:40.317169 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:40.317961 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:40.318396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:40.335031 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for project ca704726a8064214b0507190fe51650f. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:39:40.338982 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Getting quotas for user 7baa0b2ddca4431b8d006873ca90ab2c and project ca704726a8064214b0507190fe51650f. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:39:40.355700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:39:40.355700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:39:40.400135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-384575cd-b075-49c8-bf6e-4f57366c2357 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566804 Jul 21 08:39:40.401096 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 499/992] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:39:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:39:40.411051 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b620955e-71c6-455b-bf3c-269461ec44df tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:40.412351 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b620955e-71c6-455b-bf3c-269461ec44df tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:40.467741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b620955e-71c6-455b-bf3c-269461ec44df tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:40.475343 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b620955e-71c6-455b-bf3c-269461ec44df tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1242 microversion: 2.1 time: 0.068022 Jul 21 08:39:40.476129 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 494/993] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:40 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:41.492918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4c256119-87f6-4706-b30a-7d28afa93fca tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:41.493531 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4c256119-87f6-4706-b30a-7d28afa93fca tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:41.500052 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c256119-87f6-4706-b30a-7d28afa93fca tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:41.500510 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c256119-87f6-4706-b30a-7d28afa93fca tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:41.501285 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c256119-87f6-4706-b30a-7d28afa93fca tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:41.502010 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c256119-87f6-4706-b30a-7d28afa93fca tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:41.572441 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4c256119-87f6-4706-b30a-7d28afa93fca tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:41.580079 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4c256119-87f6-4706-b30a-7d28afa93fca tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1300 microversion: 2.1 time: 0.091441 Jul 21 08:39:41.586584 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 500/994] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:41 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:42.599177 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-96d45183-0fa6-49e7-8b76-d9c767477f95 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:42.600532 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-96d45183-0fa6-49e7-8b76-d9c767477f95 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:42.618974 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96d45183-0fa6-49e7-8b76-d9c767477f95 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:42.619487 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96d45183-0fa6-49e7-8b76-d9c767477f95 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:42.620265 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96d45183-0fa6-49e7-8b76-d9c767477f95 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:42.620697 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96d45183-0fa6-49e7-8b76-d9c767477f95 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:42.718752 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-31fcf825-4004-400c-9e7d-6b3d2637bcca req-a04c1300-314c-4f6c-9623-81f536d4455e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ccd8f3-1c61-4d7f-a676-a02e40775524", "tag": "853b5b7d-3530-4fb4-877f-749287247a5b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:42.731357 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-31fcf825-4004-400c-9e7d-6b3d2637bcca req-a04c1300-314c-4f6c-9623-81f536d4455e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:42.732606 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-31fcf825-4004-400c-9e7d-6b3d2637bcca req-a04c1300-314c-4f6c-9623-81f536d4455e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:42.756153 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-31fcf825-4004-400c-9e7d-6b3d2637bcca req-a04c1300-314c-4f6c-9623-81f536d4455e service nova] Creating event network-changed:853b5b7d-3530-4fb4-877f-749287247a5b for instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 on hv-cinder-85032 Jul 21 08:39:42.761817 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-31fcf825-4004-400c-9e7d-6b3d2637bcca req-a04c1300-314c-4f6c-9623-81f536d4455e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046819 Jul 21 08:39:42.762838 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 501/995] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:39:42.839574 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-96d45183-0fa6-49e7-8b76-d9c767477f95 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:42.847530 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-96d45183-0fa6-49e7-8b76-d9c767477f95 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1368 microversion: 2.1 time: 0.253036 Jul 21 08:39:42.856771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 495/996] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:42 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:43.865410 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9158ed19-81ed-48b0-8024-c42abfc36f4c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:43.866034 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9158ed19-81ed-48b0-8024-c42abfc36f4c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:43.872814 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9158ed19-81ed-48b0-8024-c42abfc36f4c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:43.873288 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9158ed19-81ed-48b0-8024-c42abfc36f4c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:43.874044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9158ed19-81ed-48b0-8024-c42abfc36f4c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:43.874483 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9158ed19-81ed-48b0-8024-c42abfc36f4c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:44.010484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9158ed19-81ed-48b0-8024-c42abfc36f4c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:44.017911 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9158ed19-81ed-48b0-8024-c42abfc36f4c tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1368 microversion: 2.1 time: 0.157360 Jul 21 08:39:44.018509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 502/997] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:43 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:45.034969 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ebfd48a-09a0-4d32-8ee3-8ddc2c3bfd2d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:45.035661 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7ebfd48a-09a0-4d32-8ee3-8ddc2c3bfd2d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:45.042825 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ebfd48a-09a0-4d32-8ee3-8ddc2c3bfd2d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:45.043273 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ebfd48a-09a0-4d32-8ee3-8ddc2c3bfd2d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:45.044085 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ebfd48a-09a0-4d32-8ee3-8ddc2c3bfd2d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:45.044520 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ebfd48a-09a0-4d32-8ee3-8ddc2c3bfd2d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:45.172039 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7ebfd48a-09a0-4d32-8ee3-8ddc2c3bfd2d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:45.179405 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ebfd48a-09a0-4d32-8ee3-8ddc2c3bfd2d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1368 microversion: 2.1 time: 0.148215 Jul 21 08:39:45.179989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 496/998] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:45 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:46.198102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-711d0730-a568-4d1e-b22a-0b2fa70907ae tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:46.198773 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-711d0730-a568-4d1e-b22a-0b2fa70907ae tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:46.205300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-711d0730-a568-4d1e-b22a-0b2fa70907ae tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:46.205755 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-711d0730-a568-4d1e-b22a-0b2fa70907ae tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:46.206532 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-711d0730-a568-4d1e-b22a-0b2fa70907ae tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:46.206970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-711d0730-a568-4d1e-b22a-0b2fa70907ae tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:46.336206 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-711d0730-a568-4d1e-b22a-0b2fa70907ae tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:46.343715 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-711d0730-a568-4d1e-b22a-0b2fa70907ae tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1368 microversion: 2.1 time: 0.149508 Jul 21 08:39:46.344279 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 503/999] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:46 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:47.360553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4753314-e71f-4832-a89c-609c7d307eab tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:47.361166 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4753314-e71f-4832-a89c-609c7d307eab tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:47.368190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4753314-e71f-4832-a89c-609c7d307eab tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:47.368632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4753314-e71f-4832-a89c-609c7d307eab tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:47.369389 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4753314-e71f-4832-a89c-609c7d307eab tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:47.369817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4753314-e71f-4832-a89c-609c7d307eab tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:47.498649 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4753314-e71f-4832-a89c-609c7d307eab tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:47.506355 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4753314-e71f-4832-a89c-609c7d307eab tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1368 microversion: 2.1 time: 0.149742 Jul 21 08:39:47.506917 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 497/1000] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:47 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:47.884137 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-b04ba6d3-2edd-4af0-8c65-b7aa9bac4605 req-013544ad-0983-4643-86e0-c3975b627a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ccd8f3-1c61-4d7f-a676-a02e40775524", "name": "network-vif-plugged", "status": "completed", "tag": "853b5b7d-3530-4fb4-877f-749287247a5b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:47.892700 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-b04ba6d3-2edd-4af0-8c65-b7aa9bac4605 req-013544ad-0983-4643-86e0-c3975b627a27 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:47.893149 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-b04ba6d3-2edd-4af0-8c65-b7aa9bac4605 req-013544ad-0983-4643-86e0-c3975b627a27 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:47.906975 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-b04ba6d3-2edd-4af0-8c65-b7aa9bac4605 req-013544ad-0983-4643-86e0-c3975b627a27 service nova] Creating event network-vif-plugged:853b5b7d-3530-4fb4-877f-749287247a5b for instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 on hv-cinder-85032 Jul 21 08:39:47.912436 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-b04ba6d3-2edd-4af0-8c65-b7aa9bac4605 req-013544ad-0983-4643-86e0-c3975b627a27 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031499 Jul 21 08:39:47.913784 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 504/1001] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:39:48.523763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b11afd37-5adb-4f28-9918-948e7e4c87d1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:48.524378 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b11afd37-5adb-4f28-9918-948e7e4c87d1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:48.530786 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b11afd37-5adb-4f28-9918-948e7e4c87d1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:48.531252 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b11afd37-5adb-4f28-9918-948e7e4c87d1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:48.532045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b11afd37-5adb-4f28-9918-948e7e4c87d1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:48.532480 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b11afd37-5adb-4f28-9918-948e7e4c87d1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:48.660840 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b11afd37-5adb-4f28-9918-948e7e4c87d1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:48.669045 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b11afd37-5adb-4f28-9918-948e7e4c87d1 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1368 microversion: 2.1 time: 0.149867 Jul 21 08:39:48.669615 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 498/1002] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:48 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:49.685780 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4d55568d-23e2-4881-a64b-ed3e1406153b tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:49.686469 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4d55568d-23e2-4881-a64b-ed3e1406153b tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:49.693571 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d55568d-23e2-4881-a64b-ed3e1406153b tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:49.694015 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d55568d-23e2-4881-a64b-ed3e1406153b tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:49.694770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d55568d-23e2-4881-a64b-ed3e1406153b tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:49.695201 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d55568d-23e2-4881-a64b-ed3e1406153b tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:49.820529 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4d55568d-23e2-4881-a64b-ed3e1406153b tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:39:49.829804 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4d55568d-23e2-4881-a64b-ed3e1406153b tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1559 microversion: 2.1 time: 0.148247 Jul 21 08:39:49.830393 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 505/1003] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:39:49 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:39:49.846510 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae7180eb-9d31-4729-8c70-3e21c3be2724 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:39:49.846983 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae7180eb-9d31-4729-8c70-3e21c3be2724 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:39:49.853607 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae7180eb-9d31-4729-8c70-3e21c3be2724 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:49.854059 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae7180eb-9d31-4729-8c70-3e21c3be2724 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:49.854820 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae7180eb-9d31-4729-8c70-3e21c3be2724 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:49.855255 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae7180eb-9d31-4729-8c70-3e21c3be2724 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:49.932378 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae7180eb-9d31-4729-8c70-3e21c3be2724 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089648 Jul 21 08:39:49.932973 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 499/1004] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 21 08:39:49 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:39:50.876538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-9a939108-347d-4d24-ac6c-8a1782245c5d req-c924029b-587f-429e-949f-7da166d9b80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ccd8f3-1c61-4d7f-a676-a02e40775524", "tag": "853b5b7d-3530-4fb4-877f-749287247a5b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:39:50.881840 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:50.882522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:50.890404 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-9a939108-347d-4d24-ac6c-8a1782245c5d req-c924029b-587f-429e-949f-7da166d9b80e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:39:50.890856 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-9a939108-347d-4d24-ac6c-8a1782245c5d req-c924029b-587f-429e-949f-7da166d9b80e service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:39:50.906707 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-9a939108-347d-4d24-ac6c-8a1782245c5d req-c924029b-587f-429e-949f-7da166d9b80e service nova] Creating event network-changed:853b5b7d-3530-4fb4-877f-749287247a5b for instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 on hv-cinder-85032 Jul 21 08:39:50.912081 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-9a939108-347d-4d24-ac6c-8a1782245c5d req-c924029b-587f-429e-949f-7da166d9b80e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039356 Jul 21 08:39:50.912687 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 506/1005] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:40:07.184805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:07.186160 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:07.186792 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:07.190832 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6c42b3ef-ea38-4cbf-ac84-d4435c634d57 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:07.191342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6c42b3ef-ea38-4cbf-ac84-d4435c634d57 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:07.199644 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c42b3ef-ea38-4cbf-ac84-d4435c634d57 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:07.200088 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c42b3ef-ea38-4cbf-ac84-d4435c634d57 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:07.200840 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c42b3ef-ea38-4cbf-ac84-d4435c634d57 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:07.201271 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c42b3ef-ea38-4cbf-ac84-d4435c634d57 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:07.281465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-6c42b3ef-ea38-4cbf-ac84-d4435c634d57 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lazy-loading 'services' on Instance uuid 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:40:07.352776 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6c42b3ef-ea38-4cbf-ac84-d4435c634d57 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/os-volume_attachments/1939c9bb-b167-496e-b1fc-7e4f87f30cf1" status: 202 len: 0 microversion: 2.1 time: 0.168455 Jul 21 08:40:07.353360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 500/1006] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:40:07 2022] DELETE /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/os-volume_attachments/1939c9bb-b167-496e-b1fc-7e4f87f30cf1 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:40:08.460238 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:08.461094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=44 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:08.465247 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0fee7ddf-d6a1-48c0-851c-d6da4d280895 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:40:08.472523 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0fee7ddf-d6a1-48c0-851c-d6da4d280895 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:08.473470 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0fee7ddf-d6a1-48c0-851c-d6da4d280895 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:08.496888 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0fee7ddf-d6a1-48c0-851c-d6da4d280895 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Going to try to stop instance {{(pid=117950) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 08:40:08.539259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0fee7ddf-d6a1-48c0-851c-d6da4d280895 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/action" status: 202 len: 0 microversion: 2.1 time: 0.080211 Jul 21 08:40:08.540022 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 507/1007] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:40:08 2022] POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:40:08.548475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81c7f97d-edfa-426c-b0de-045b625613bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:08.549228 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81c7f97d-edfa-426c-b0de-045b625613bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:08.556939 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81c7f97d-edfa-426c-b0de-045b625613bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:08.557383 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81c7f97d-edfa-426c-b0de-045b625613bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:08.558391 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81c7f97d-edfa-426c-b0de-045b625613bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:08.558989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81c7f97d-edfa-426c-b0de-045b625613bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:08.697477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-81c7f97d-edfa-426c-b0de-045b625613bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:08.704968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81c7f97d-edfa-426c-b0de-045b625613bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.160741 Jul 21 08:40:08.705525 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 501/1008] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:08 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:09.722822 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-89d132de-0a65-415d-b2a4-5125a0dadff5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:09.723554 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-89d132de-0a65-415d-b2a4-5125a0dadff5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:09.730178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-89d132de-0a65-415d-b2a4-5125a0dadff5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:09.730629 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-89d132de-0a65-415d-b2a4-5125a0dadff5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:09.731426 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-89d132de-0a65-415d-b2a4-5125a0dadff5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:09.731873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-89d132de-0a65-415d-b2a4-5125a0dadff5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:09.866138 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-89d132de-0a65-415d-b2a4-5125a0dadff5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:09.873698 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-89d132de-0a65-415d-b2a4-5125a0dadff5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.155120 Jul 21 08:40:09.874282 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 508/1009] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:09 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:10.892026 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8eba13d-ee35-4c20-a54e-a17bd42b330a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:10.892648 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d8eba13d-ee35-4c20-a54e-a17bd42b330a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:10.900124 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8eba13d-ee35-4c20-a54e-a17bd42b330a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:10.900575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8eba13d-ee35-4c20-a54e-a17bd42b330a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:10.901352 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8eba13d-ee35-4c20-a54e-a17bd42b330a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:10.901789 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8eba13d-ee35-4c20-a54e-a17bd42b330a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:11.030292 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d8eba13d-ee35-4c20-a54e-a17bd42b330a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:11.037746 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d8eba13d-ee35-4c20-a54e-a17bd42b330a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.149661 Jul 21 08:40:11.038310 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 502/1010] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:10 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:12.053910 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c514d347-e5a5-45fa-9176-8689079ff58f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:12.054500 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c514d347-e5a5-45fa-9176-8689079ff58f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:12.061418 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c514d347-e5a5-45fa-9176-8689079ff58f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:12.061878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c514d347-e5a5-45fa-9176-8689079ff58f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:12.062697 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c514d347-e5a5-45fa-9176-8689079ff58f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:12.063146 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c514d347-e5a5-45fa-9176-8689079ff58f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:12.190327 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c514d347-e5a5-45fa-9176-8689079ff58f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:12.198330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c514d347-e5a5-45fa-9176-8689079ff58f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.148241 Jul 21 08:40:12.198899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 509/1011] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:12 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:13.215126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5f69c9ff-9451-45a9-ad46-5e813b3c911f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:13.215757 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5f69c9ff-9451-45a9-ad46-5e813b3c911f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:13.222205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f69c9ff-9451-45a9-ad46-5e813b3c911f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:13.222645 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f69c9ff-9451-45a9-ad46-5e813b3c911f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:13.223930 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f69c9ff-9451-45a9-ad46-5e813b3c911f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:13.224357 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f69c9ff-9451-45a9-ad46-5e813b3c911f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:13.522507 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5f69c9ff-9451-45a9-ad46-5e813b3c911f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:13.529980 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5f69c9ff-9451-45a9-ad46-5e813b3c911f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.318702 Jul 21 08:40:13.530546 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 503/1012] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:13 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:14.547720 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-650a4689-dd15-411d-8935-fada6b753846 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:14.548333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-650a4689-dd15-411d-8935-fada6b753846 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:14.555574 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-650a4689-dd15-411d-8935-fada6b753846 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:14.556043 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-650a4689-dd15-411d-8935-fada6b753846 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:14.556809 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-650a4689-dd15-411d-8935-fada6b753846 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:14.557226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-650a4689-dd15-411d-8935-fada6b753846 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:14.688984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-650a4689-dd15-411d-8935-fada6b753846 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:14.696378 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-650a4689-dd15-411d-8935-fada6b753846 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.152544 Jul 21 08:40:14.696942 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 510/1013] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:14 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:15.713431 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54ed3283-e219-49f1-a841-cde9fbb0e6bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:15.714027 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54ed3283-e219-49f1-a841-cde9fbb0e6bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:15.720238 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54ed3283-e219-49f1-a841-cde9fbb0e6bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:15.720681 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54ed3283-e219-49f1-a841-cde9fbb0e6bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:15.721438 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54ed3283-e219-49f1-a841-cde9fbb0e6bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:15.721871 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54ed3283-e219-49f1-a841-cde9fbb0e6bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:15.854653 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-54ed3283-e219-49f1-a841-cde9fbb0e6bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:15.862263 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54ed3283-e219-49f1-a841-cde9fbb0e6bb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.152737 Jul 21 08:40:15.862832 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 504/1014] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:15 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:16.881379 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-af243383-029f-4be3-96b5-07d63c3d48b5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:16.882051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-af243383-029f-4be3-96b5-07d63c3d48b5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:16.888627 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af243383-029f-4be3-96b5-07d63c3d48b5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:16.889077 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af243383-029f-4be3-96b5-07d63c3d48b5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:16.889845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af243383-029f-4be3-96b5-07d63c3d48b5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:16.890282 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af243383-029f-4be3-96b5-07d63c3d48b5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:17.073859 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-af243383-029f-4be3-96b5-07d63c3d48b5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:17.081269 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-af243383-029f-4be3-96b5-07d63c3d48b5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.205034 Jul 21 08:40:17.081836 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 511/1015] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:16 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:18.098511 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f8a3451c-2597-49d1-8cb1-d18cbcff07ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:18.099139 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f8a3451c-2597-49d1-8cb1-d18cbcff07ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:18.106008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8a3451c-2597-49d1-8cb1-d18cbcff07ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:18.106457 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8a3451c-2597-49d1-8cb1-d18cbcff07ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:18.107227 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8a3451c-2597-49d1-8cb1-d18cbcff07ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:18.107689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8a3451c-2597-49d1-8cb1-d18cbcff07ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:18.234179 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f8a3451c-2597-49d1-8cb1-d18cbcff07ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:18.242137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f8a3451c-2597-49d1-8cb1-d18cbcff07ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1676 microversion: 2.1 time: 0.147618 Jul 21 08:40:18.242710 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 505/1016] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:18 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:19.259484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-63162ded-0571-4e9a-9d92-520fa8a0ed5c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:19.260102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-63162ded-0571-4e9a-9d92-520fa8a0ed5c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:19.266772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63162ded-0571-4e9a-9d92-520fa8a0ed5c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:19.267233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63162ded-0571-4e9a-9d92-520fa8a0ed5c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:19.268028 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63162ded-0571-4e9a-9d92-520fa8a0ed5c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:19.268472 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63162ded-0571-4e9a-9d92-520fa8a0ed5c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:19.401232 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63162ded-0571-4e9a-9d92-520fa8a0ed5c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:19.408920 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-63162ded-0571-4e9a-9d92-520fa8a0ed5c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1653 microversion: 2.1 time: 0.153336 Jul 21 08:40:19.409495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 512/1017] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:19 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1653 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:19.425565 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e892ea9-a531-4615-89b8-3427e3d1275e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:40:19.432631 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e892ea9-a531-4615-89b8-3427e3d1275e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:19.433105 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e892ea9-a531-4615-89b8-3427e3d1275e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:19.492595 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e892ea9-a531-4615-89b8-3427e3d1275e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Going to try to start instance {{(pid=117951) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 08:40:19.534302 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e892ea9-a531-4615-89b8-3427e3d1275e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/action" status: 202 len: 0 microversion: 2.1 time: 0.112324 Jul 21 08:40:19.535086 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 506/1018] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Jul 21 08:40:19 2022] POST /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:40:19.543861 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-46a4176f-aeab-4570-894c-102cac5a21fe tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:19.544473 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-46a4176f-aeab-4570-894c-102cac5a21fe tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:19.550509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46a4176f-aeab-4570-894c-102cac5a21fe tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:19.550899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46a4176f-aeab-4570-894c-102cac5a21fe tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:19.551701 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46a4176f-aeab-4570-894c-102cac5a21fe tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:19.552148 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-46a4176f-aeab-4570-894c-102cac5a21fe tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:19.685225 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-46a4176f-aeab-4570-894c-102cac5a21fe tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:19.693382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-46a4176f-aeab-4570-894c-102cac5a21fe tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1662 microversion: 2.1 time: 0.153354 Jul 21 08:40:19.694156 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 513/1019] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:19 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:20.710901 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a9ca68fd-4868-4570-832c-3542a277b261 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:20.711636 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a9ca68fd-4868-4570-832c-3542a277b261 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:20.718612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9ca68fd-4868-4570-832c-3542a277b261 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:20.719059 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9ca68fd-4868-4570-832c-3542a277b261 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:20.719861 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9ca68fd-4868-4570-832c-3542a277b261 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:20.720301 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9ca68fd-4868-4570-832c-3542a277b261 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:20.854354 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9ca68fd-4868-4570-832c-3542a277b261 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:20.861771 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a9ca68fd-4868-4570-832c-3542a277b261 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1662 microversion: 2.1 time: 0.155688 Jul 21 08:40:20.862335 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 507/1020] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:20 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:21.880553 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d3252f1e-c658-4956-b65d-a72d81862ac6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:21.881174 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d3252f1e-c658-4956-b65d-a72d81862ac6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:21.887737 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3252f1e-c658-4956-b65d-a72d81862ac6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:21.888191 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3252f1e-c658-4956-b65d-a72d81862ac6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:21.888961 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3252f1e-c658-4956-b65d-a72d81862ac6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:21.889402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3252f1e-c658-4956-b65d-a72d81862ac6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:22.015527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d3252f1e-c658-4956-b65d-a72d81862ac6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:22.023120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d3252f1e-c658-4956-b65d-a72d81862ac6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1666 microversion: 2.1 time: 0.147305 Jul 21 08:40:22.023719 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 514/1021] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:21 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:40:53.585361 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fcacc584-3096-4790-87fa-5adddb538fc2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:53.585984 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fcacc584-3096-4790-87fa-5adddb538fc2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:53.588220 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=16 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:53.588877 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:53.594761 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcacc584-3096-4790-87fa-5adddb538fc2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:53.595205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcacc584-3096-4790-87fa-5adddb538fc2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:53.595998 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcacc584-3096-4790-87fa-5adddb538fc2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:53.596964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcacc584-3096-4790-87fa-5adddb538fc2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:53.620741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fcacc584-3096-4790-87fa-5adddb538fc2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/ips" status: 200 len: 151 microversion: 2.1 time: 0.039751 Jul 21 08:40:53.621323 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 508/1022] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:40:53 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:40:54.206330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-76ad682f-2652-4412-a14f-ad298d8e1cc9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:54.207272 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-76ad682f-2652-4412-a14f-ad298d8e1cc9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:54.209694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=16 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:54.210445 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:54.216605 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76ad682f-2652-4412-a14f-ad298d8e1cc9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:54.217057 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76ad682f-2652-4412-a14f-ad298d8e1cc9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:54.217828 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76ad682f-2652-4412-a14f-ad298d8e1cc9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:54.218271 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76ad682f-2652-4412-a14f-ad298d8e1cc9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:54.250231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-76ad682f-2652-4412-a14f-ad298d8e1cc9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048570 Jul 21 08:40:54.250786 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 515/1023] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:40:54 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:40:54.307626 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e1fe20e9-f73e-472c-bd51-d467c6fce4e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:54.308117 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e1fe20e9-f73e-472c-bd51-d467c6fce4e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:54.314004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1fe20e9-f73e-472c-bd51-d467c6fce4e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:54.314444 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1fe20e9-f73e-472c-bd51-d467c6fce4e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:54.315848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1fe20e9-f73e-472c-bd51-d467c6fce4e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:54.316274 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1fe20e9-f73e-472c-bd51-d467c6fce4e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:54.343227 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e1fe20e9-f73e-472c-bd51-d467c6fce4e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:40:54.416727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e1fe20e9-f73e-472c-bd51-d467c6fce4e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 204 len: 0 microversion: 2.1 time: 0.112583 Jul 21 08:40:54.417245 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 509/1024] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:40:54 2022] DELETE /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:40:54.426552 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-87f4d3c4-a023-42ce-a049-88d701d9be37 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:54.427190 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-87f4d3c4-a023-42ce-a049-88d701d9be37 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:54.433198 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87f4d3c4-a023-42ce-a049-88d701d9be37 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:54.433639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87f4d3c4-a023-42ce-a049-88d701d9be37 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:54.434395 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87f4d3c4-a023-42ce-a049-88d701d9be37 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:54.434899 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87f4d3c4-a023-42ce-a049-88d701d9be37 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:54.567184 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-87f4d3c4-a023-42ce-a049-88d701d9be37 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:54.574749 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-87f4d3c4-a023-42ce-a049-88d701d9be37 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1672 microversion: 2.1 time: 0.152595 Jul 21 08:40:54.575310 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 516/1025] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:54 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:40:54.937590 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04858c7c-b5e5-4a32-a331-17689d5b5f0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47c0fc32-db55-4a6b-8bf1-d49244da7776"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:40:54.938741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-04858c7c-b5e5-4a32-a331-17689d5b5f0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:54.945815 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04858c7c-b5e5-4a32-a331-17689d5b5f0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:54.946256 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04858c7c-b5e5-4a32-a331-17689d5b5f0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:54.947014 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04858c7c-b5e5-4a32-a331-17689d5b5f0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:54.947478 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04858c7c-b5e5-4a32-a331-17689d5b5f0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:55.592162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b8c3ac60-335b-4335-81d1-db5e029438ce tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:55.592778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b8c3ac60-335b-4335-81d1-db5e029438ce tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:55.600010 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac60-335b-4335-81d1-db5e029438ce tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:55.600465 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac60-335b-4335-81d1-db5e029438ce tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:55.601231 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac60-335b-4335-81d1-db5e029438ce tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:55.601669 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8c3ac60-335b-4335-81d1-db5e029438ce tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:55.728535 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b8c3ac60-335b-4335-81d1-db5e029438ce tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:55.736144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b8c3ac60-335b-4335-81d1-db5e029438ce tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1672 microversion: 2.1 time: 0.147989 Jul 21 08:40:55.736640 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 517/1026] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:55 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:40:56.298120 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-04858c7c-b5e5-4a32-a331-17689d5b5f0e tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "POST /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.364455 Jul 21 08:40:56.300948 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 510/1027] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:40:54 2022] POST /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-volume_attachments => generated 194 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:40:56.754721 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-30590fda-3ef1-4af7-aa57-e0777723c041 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:56.755275 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-30590fda-3ef1-4af7-aa57-e0777723c041 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:56.762907 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30590fda-3ef1-4af7-aa57-e0777723c041 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:56.763471 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30590fda-3ef1-4af7-aa57-e0777723c041 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:56.764538 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30590fda-3ef1-4af7-aa57-e0777723c041 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:56.765057 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30590fda-3ef1-4af7-aa57-e0777723c041 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:56.909178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-30590fda-3ef1-4af7-aa57-e0777723c041 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:56.917217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-30590fda-3ef1-4af7-aa57-e0777723c041 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1672 microversion: 2.1 time: 0.167178 Jul 21 08:40:56.917906 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 518/1028] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:56 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:57.634474 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-2b95ab9b-de75-4909-bcff-80b4898f4f09 req-2a422673-5134-4e13-a930-f994fa382ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4765bcf7-c1c0-48bc-92d9-2d6b53cad403", "name": "network-vif-deleted", "tag": "f1a1b98b-aa28-4bb1-ad48-eca57a3a9e49"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:40:57.645013 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2b95ab9b-de75-4909-bcff-80b4898f4f09 req-2a422673-5134-4e13-a930-f994fa382ac8 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:57.645817 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-2b95ab9b-de75-4909-bcff-80b4898f4f09 req-2a422673-5134-4e13-a930-f994fa382ac8 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:57.660808 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-2b95ab9b-de75-4909-bcff-80b4898f4f09 req-2a422673-5134-4e13-a930-f994fa382ac8 service nova] Creating event network-vif-deleted:f1a1b98b-aa28-4bb1-ad48-eca57a3a9e49 for instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 on hv-cinder-85032 Jul 21 08:40:57.666704 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-2b95ab9b-de75-4909-bcff-80b4898f4f09 req-2a422673-5134-4e13-a930-f994fa382ac8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101424 Jul 21 08:40:57.668363 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 511/1029] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:40:57.935505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:57.936762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:57.943862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:57.944318 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:57.945100 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:57.945682 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:57.981030 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:57.981553 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:57.982077 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lazy-loading 'fault' on Instance uuid 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:40:58.024853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:40:58.032800 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5f31450a-344c-4b49-b5f5-8c7d82c185a5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 200 len: 1325 microversion: 2.1 time: 0.101245 Jul 21 08:40:58.033718 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 519/1030] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:57 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 1325 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:40:59.056097 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:59.056793 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:40:59.063611 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:59.064085 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:59.064844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:40:59.065277 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:40:59.078572 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] HTTP exception thrown: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Request method failure captured: Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 HTTP/1.1 Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RB38futWQgL4o87Q1TFTFIRhyNjhd7MGEfCywTh5k-Vr8wDoXUOyHbHK7aNaBIHJAykGHP8dDsZ__IZ3Pskg8s-Cgcng5WmMwThBRFwJqC90SO9aNAAiwbOGb7Bu3RFAE8_52GCNxHIB6JtdIYyR718XoANduX0dYB4ib1T3Tlp-wo Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:40:59.081360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 591ec12e19db47139d3a73484abf2f0d Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:40:59.083074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '4765bcf7-c1c0-48bc-92d9-2d6b53cad403'} Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:40:59.084006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:40:59.085331 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:40:59.086561 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Returning 404 to user: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:40:59.086561 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4aa07f6c-b5cf-41c6-90e9-4954bf5f6c6f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 404 len: 111 microversion: 2.1 time: 0.030894 Jul 21 08:40:59.086561 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 512/1031] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:40:59 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:59.091741 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91c40a1c-9d9a-40a7-91ab-9fd5e44cfba6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '.version_select at 0x7f65bc301040>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:40:59.109414 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-91c40a1c-9d9a-40a7-91ab-9fd5e44cfba6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-619783907" status: 202 len: 0 microversion: 2.1 time: 0.021483 Jul 21 08:40:59.109973 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 520/1032] 10.222.0.47 () {58 vars in 1217 bytes} [Thu Jul 21 08:40:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-619783907 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:40:59.999995 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4779da0-ee0b-4484-b3cb-ea9ad5877c1a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'create', calling method: .version_select at 0x7f65c0b36430>, body: {"keypair": {"name": "tempest-keypair-1178891718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUT/a2kxVKlZtQv2vwZv7mLeqnuzDuCZgSLMW2UMz3Fj+Tl2p6IH/msoCZH6gnWAntpTf5tNyMSnRqx6IbAyCrgAiac7HOHvAnJASt0OooP8QVvqCZFttMEzTIkq/YVwg=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:41:00.014686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-f4779da0-ee0b-4484-b3cb-ea9ad5877c1a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Getting quotas for project d588f87ef1d248528ec37cd9b5d43dcc. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:41:00.019390 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-f4779da0-ee0b-4484-b3cb-ea9ad5877c1a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Getting quotas for user 591ec12e19db47139d3a73484abf2f0d and project d588f87ef1d248528ec37cd9b5d43dcc. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:41:00.040731 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4779da0-ee0b-4484-b3cb-ea9ad5877c1a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044579 Jul 21 08:41:00.041316 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 513/1033] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:40:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:01.312381 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2075710687", "imageRef": "5087585c-fe41-4781-8c65-94c8bf3e095a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1faf8c46-062e-421f-966c-780575268200"}], "security_groups": [{"name": "tempest-securitygroup--857548198"}], "key_name": "tempest-keypair-1178891718", "user_data": "}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:41:01.414998 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] validate_networks() for [('1faf8c46-062e-421f-966c-780575268200', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:41:01.791313 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:41:01.791756 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:41:01.792227 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:41:01.792664 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:41:01.793100 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:41:01.801972 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:01.802414 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:01.803210 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:01.803670 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:01.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Getting quotas for project d588f87ef1d248528ec37cd9b5d43dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:41:01.823702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Getting quotas for user 591ec12e19db47139d3a73484abf2f0d and project d588f87ef1d248528ec37cd9b5d43dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:41:01.834818 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:41:01.837059 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5087585c-fe41-4781-8c65-94c8bf3e095a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:41:01.885967 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bdb88dbf-aea2-495a-a260-e440cc7e9a3c tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.578288 Jul 21 08:41:01.886526 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 521/1034] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:41:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:41:01.896819 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75792e95-cae5-4103-9ba6-791b1d667ef7 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:01.897468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75792e95-cae5-4103-9ba6-791b1d667ef7 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:01.952750 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-75792e95-cae5-4103-9ba6-791b1d667ef7 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:01.959906 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75792e95-cae5-4103-9ba6-791b1d667ef7 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1238 microversion: 2.1 time: 0.067359 Jul 21 08:41:01.960479 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 514/1035] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:01 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:02.861937 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-90a0a557-d1ea-4c9e-9b91-39100c341683 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:02.862582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-90a0a557-d1ea-4c9e-9b91-39100c341683 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:02.869849 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90a0a557-d1ea-4c9e-9b91-39100c341683 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:02.870396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90a0a557-d1ea-4c9e-9b91-39100c341683 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:02.871354 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90a0a557-d1ea-4c9e-9b91-39100c341683 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:02.871896 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90a0a557-d1ea-4c9e-9b91-39100c341683 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:02.966957 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-90a0a557-d1ea-4c9e-9b91-39100c341683 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lazy-loading 'services' on Instance uuid 22ccd8f3-1c61-4d7f-a676-a02e40775524 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:41:02.977463 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfdb8508-f9c9-430c-9436-9f34e607a1e5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:02.978179 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfdb8508-f9c9-430c-9436-9f34e607a1e5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:02.984872 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfdb8508-f9c9-430c-9436-9f34e607a1e5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:02.985409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfdb8508-f9c9-430c-9436-9f34e607a1e5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:02.986266 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfdb8508-f9c9-430c-9436-9f34e607a1e5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:02.987914 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfdb8508-f9c9-430c-9436-9f34e607a1e5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:03.057416 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-90a0a557-d1ea-4c9e-9b91-39100c341683 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-volume_attachments/47c0fc32-db55-4a6b-8bf1-d49244da7776" status: 202 len: 0 microversion: 2.1 time: 0.200553 Jul 21 08:41:03.057902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfdb8508-f9c9-430c-9436-9f34e607a1e5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:03.061620 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 522/1036] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:41:02 2022] DELETE /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-volume_attachments/47c0fc32-db55-4a6b-8bf1-d49244da7776 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:41:03.068934 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfdb8508-f9c9-430c-9436-9f34e607a1e5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1290 microversion: 2.1 time: 0.095396 Jul 21 08:41:03.069694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ff9ca7df-0d48-4112-8a4c-3b2558594067 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:03.069821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 515/1037] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:02 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:41:03.079447 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ff9ca7df-0d48-4112-8a4c-3b2558594067 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:03.088894 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff9ca7df-0d48-4112-8a4c-3b2558594067 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:03.089552 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff9ca7df-0d48-4112-8a4c-3b2558594067 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:03.090458 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff9ca7df-0d48-4112-8a4c-3b2558594067 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:03.090996 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff9ca7df-0d48-4112-8a4c-3b2558594067 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:03.129298 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ff9ca7df-0d48-4112-8a4c-3b2558594067 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065326 Jul 21 08:41:03.130435 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 523/1038] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:41:03 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:41:04.087936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d616e3b-caf0-41de-8a30-afbfdc7d6305 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:04.088564 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d616e3b-caf0-41de-8a30-afbfdc7d6305 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:04.096119 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d616e3b-caf0-41de-8a30-afbfdc7d6305 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.096568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d616e3b-caf0-41de-8a30-afbfdc7d6305 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.097363 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d616e3b-caf0-41de-8a30-afbfdc7d6305 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.097779 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d616e3b-caf0-41de-8a30-afbfdc7d6305 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.147711 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-be01e339-5ac5-4197-90f8-69182c927eb7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:04.148646 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-be01e339-5ac5-4197-90f8-69182c927eb7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:04.159150 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be01e339-5ac5-4197-90f8-69182c927eb7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.159635 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be01e339-5ac5-4197-90f8-69182c927eb7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.160421 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be01e339-5ac5-4197-90f8-69182c927eb7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.160861 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be01e339-5ac5-4197-90f8-69182c927eb7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.198024 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-be01e339-5ac5-4197-90f8-69182c927eb7 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057878 Jul 21 08:41:04.198616 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 524/1039] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:41:04 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:41:04.264050 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ef6aec54-a4ce-4575-9db0-87f1b2777bac tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:04.264050 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ef6aec54-a4ce-4575-9db0-87f1b2777bac tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:04.270773 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef6aec54-a4ce-4575-9db0-87f1b2777bac tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.271215 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef6aec54-a4ce-4575-9db0-87f1b2777bac tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.272590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef6aec54-a4ce-4575-9db0-87f1b2777bac tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.272590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef6aec54-a4ce-4575-9db0-87f1b2777bac tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.299610 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d616e3b-caf0-41de-8a30-afbfdc7d6305 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:04.300644 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ef6aec54-a4ce-4575-9db0-87f1b2777bac tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:41:04.319706 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d616e3b-caf0-41de-8a30-afbfdc7d6305 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.236354 Jul 21 08:41:04.321435 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 516/1040] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:04 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:04.384217 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ef6aec54-a4ce-4575-9db0-87f1b2777bac tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 204 len: 0 microversion: 2.1 time: 0.124531 Jul 21 08:41:04.384962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 525/1041] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:41:04 2022] DELETE /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 08:41:04.394380 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c8b86997-aeb3-4656-b3f5-ecc50dd558e4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:04.394991 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c8b86997-aeb3-4656-b3f5-ecc50dd558e4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:04.401128 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8b86997-aeb3-4656-b3f5-ecc50dd558e4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.401568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8b86997-aeb3-4656-b3f5-ecc50dd558e4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.402341 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8b86997-aeb3-4656-b3f5-ecc50dd558e4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.402765 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8b86997-aeb3-4656-b3f5-ecc50dd558e4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.608403 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8b86997-aeb3-4656-b3f5-ecc50dd558e4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:04.616894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c8b86997-aeb3-4656-b3f5-ecc50dd558e4 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1684 microversion: 2.1 time: 0.226860 Jul 21 08:41:04.617480 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 517/1042] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:04 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1684 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:04.949967 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-04b7d26b-fc79-4712-a060-4520ff411b97 req-3ceff09d-46ae-459c-9087-2ecc9b888fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63adf61f-e7b5-40ce-aa64-750a939dd7f9", "tag": "a0642deb-22b8-49a7-8de3-19807381ac26"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:41:04.960580 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-04b7d26b-fc79-4712-a060-4520ff411b97 req-3ceff09d-46ae-459c-9087-2ecc9b888fa6 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:04.962044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-04b7d26b-fc79-4712-a060-4520ff411b97 req-3ceff09d-46ae-459c-9087-2ecc9b888fa6 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:04.982226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-04b7d26b-fc79-4712-a060-4520ff411b97 req-3ceff09d-46ae-459c-9087-2ecc9b888fa6 service nova] Creating event network-changed:a0642deb-22b8-49a7-8de3-19807381ac26 for instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 on hv-cinder-85032 Jul 21 08:41:04.987892 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-04b7d26b-fc79-4712-a060-4520ff411b97 req-3ceff09d-46ae-459c-9087-2ecc9b888fa6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045113 Jul 21 08:41:04.988506 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 526/1043] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:05.337693 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9fa1ef83-c505-4c98-8652-d848e6a3653b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:05.338235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9fa1ef83-c505-4c98-8652-d848e6a3653b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:05.344773 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9fa1ef83-c505-4c98-8652-d848e6a3653b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:05.345214 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9fa1ef83-c505-4c98-8652-d848e6a3653b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:05.346493 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9fa1ef83-c505-4c98-8652-d848e6a3653b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:05.346916 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9fa1ef83-c505-4c98-8652-d848e6a3653b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:05.483940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9fa1ef83-c505-4c98-8652-d848e6a3653b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:05.491960 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9fa1ef83-c505-4c98-8652-d848e6a3653b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.158267 Jul 21 08:41:05.492555 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 518/1044] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:05 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:05.637038 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9a277a04-57e1-4026-b5f7-c1b633031211 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:05.637655 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9a277a04-57e1-4026-b5f7-c1b633031211 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:05.644374 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a277a04-57e1-4026-b5f7-c1b633031211 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:05.644826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a277a04-57e1-4026-b5f7-c1b633031211 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:05.645593 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a277a04-57e1-4026-b5f7-c1b633031211 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:05.646038 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a277a04-57e1-4026-b5f7-c1b633031211 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:05.776570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9a277a04-57e1-4026-b5f7-c1b633031211 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:05.785522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9a277a04-57e1-4026-b5f7-c1b633031211 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1684 microversion: 2.1 time: 0.153332 Jul 21 08:41:05.786094 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 527/1045] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:05 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:06.509314 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4307589-4dce-4bd2-aa77-25f2cc303dbb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:06.509918 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d4307589-4dce-4bd2-aa77-25f2cc303dbb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:06.516449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4307589-4dce-4bd2-aa77-25f2cc303dbb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:06.516890 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4307589-4dce-4bd2-aa77-25f2cc303dbb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:06.517654 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4307589-4dce-4bd2-aa77-25f2cc303dbb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:06.518083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4307589-4dce-4bd2-aa77-25f2cc303dbb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:06.804802 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-99705fea-e772-4e7f-9d15-e74bc022eddc tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:06.805516 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-99705fea-e772-4e7f-9d15-e74bc022eddc tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:06.812671 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99705fea-e772-4e7f-9d15-e74bc022eddc tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:06.813300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99705fea-e772-4e7f-9d15-e74bc022eddc tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:06.814209 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99705fea-e772-4e7f-9d15-e74bc022eddc tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:06.814934 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99705fea-e772-4e7f-9d15-e74bc022eddc tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:06.816215 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d4307589-4dce-4bd2-aa77-25f2cc303dbb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:06.824718 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d4307589-4dce-4bd2-aa77-25f2cc303dbb tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.319035 Jul 21 08:41:06.826074 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 519/1046] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:06 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:06.959792 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-99705fea-e772-4e7f-9d15-e74bc022eddc tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:06.967851 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-99705fea-e772-4e7f-9d15-e74bc022eddc tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1684 microversion: 2.1 time: 0.167372 Jul 21 08:41:06.968427 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 528/1047] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:06 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:41:07.268894 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-856ce7eb-a006-4d43-94da-8d544ee28917 req-e4689192-915c-4392-a309-1f84f91f6599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ccd8f3-1c61-4d7f-a676-a02e40775524", "name": "network-vif-deleted", "tag": "853b5b7d-3530-4fb4-877f-749287247a5b"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:41:07.276935 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-856ce7eb-a006-4d43-94da-8d544ee28917 req-e4689192-915c-4392-a309-1f84f91f6599 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:07.277465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-856ce7eb-a006-4d43-94da-8d544ee28917 req-e4689192-915c-4392-a309-1f84f91f6599 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:07.288988 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-856ce7eb-a006-4d43-94da-8d544ee28917 req-e4689192-915c-4392-a309-1f84f91f6599 service nova] Creating event network-vif-deleted:853b5b7d-3530-4fb4-877f-749287247a5b for instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 on hv-cinder-85032 Jul 21 08:41:07.295157 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-856ce7eb-a006-4d43-94da-8d544ee28917 req-e4689192-915c-4392-a309-1f84f91f6599 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030439 Jul 21 08:41:07.295853 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 520/1048] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:07.842293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cbbc5ae0-73f6-4e6f-940d-981cecfd338b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:07.843076 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cbbc5ae0-73f6-4e6f-940d-981cecfd338b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:07.849799 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cbbc5ae0-73f6-4e6f-940d-981cecfd338b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:07.850486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cbbc5ae0-73f6-4e6f-940d-981cecfd338b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:07.851782 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cbbc5ae0-73f6-4e6f-940d-981cecfd338b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:07.852495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cbbc5ae0-73f6-4e6f-940d-981cecfd338b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:07.984921 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:07.985613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:07.991928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cbbc5ae0-73f6-4e6f-940d-981cecfd338b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:07.993136 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:07.993671 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:07.994643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:07.995118 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:08.005197 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cbbc5ae0-73f6-4e6f-940d-981cecfd338b tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.166602 Jul 21 08:41:08.017036 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 529/1049] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:07 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:08.031642 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:08.032103 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:08.032556 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lazy-loading 'fault' on Instance uuid 22ccd8f3-1c61-4d7f-a676-a02e40775524 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:41:08.083008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baa0b2ddca4431b8d006873ca90ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca704726a8064214b0507190fe51650f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:08.092136 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f264590-2599-4929-82d1-9485f9a202ea tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 200 len: 1332 microversion: 2.1 time: 0.111204 Jul 21 08:41:08.093017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 521/1050] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:07 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:09.023938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4b471408-8cc1-4ce8-b5e2-caeb77df3094 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:09.024595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4b471408-8cc1-4ce8-b5e2-caeb77df3094 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:09.031383 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b471408-8cc1-4ce8-b5e2-caeb77df3094 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:09.031835 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b471408-8cc1-4ce8-b5e2-caeb77df3094 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:09.032614 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b471408-8cc1-4ce8-b5e2-caeb77df3094 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:09.033601 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b471408-8cc1-4ce8-b5e2-caeb77df3094 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:09.110218 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:09.110897 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:09.119701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:09.120249 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:09.121139 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:09.121644 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:09.136374 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 HTTP/1.1 Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:41:09.138137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:09.139923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '22ccd8f3-1c61-4d7f-a676-a02e40775524'} Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:09.140763 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:09.142199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:09.143612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:09.143612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13083662-c41e-4633-8ca5-c3359b8d4fde tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 404 len: 111 microversion: 2.1 time: 0.034914 Jul 21 08:41:09.143612 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 522/1051] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:09 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:41:09.150091 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c751f6a0-c1c5-46d2-b237-5513b9ee11d6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '.version_select at 0x7f65c0b8c310>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:09.168386 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c751f6a0-c1c5-46d2-b237-5513b9ee11d6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690557687" status: 202 len: 0 microversion: 2.1 time: 0.022061 Jul 21 08:41:09.168970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 523/1052] 10.222.0.47 () {58 vars in 1220 bytes} [Thu Jul 21 08:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690557687 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 08:41:09.176474 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4b471408-8cc1-4ce8-b5e2-caeb77df3094 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:09.184681 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4b471408-8cc1-4ce8-b5e2-caeb77df3094 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.165003 Jul 21 08:41:09.185568 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 530/1053] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:09 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:10.202310 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c448259d-485f-4b09-b456-26ffed200712 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:10.202919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c448259d-485f-4b09-b456-26ffed200712 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:10.210236 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c448259d-485f-4b09-b456-26ffed200712 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:10.210607 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c448259d-485f-4b09-b456-26ffed200712 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:10.211393 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c448259d-485f-4b09-b456-26ffed200712 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:10.211830 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c448259d-485f-4b09-b456-26ffed200712 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:10.349849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c448259d-485f-4b09-b456-26ffed200712 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:10.361165 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c448259d-485f-4b09-b456-26ffed200712 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.163119 Jul 21 08:41:10.361979 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 524/1054] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:10 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:11.168757 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:11.169268 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:11.176289 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:11.176735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:11.177495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:11.177924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:11.181948 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:11.192111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 HTTP/1.1 Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:41:11.193758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.195382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '22ccd8f3-1c61-4d7f-a676-a02e40775524'} Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:11.196323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.197826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.199402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:11.199402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dfc0e5f0-d2b2-4d5b-8564-6fa3f11c5b41 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 404 len: 111 microversion: 2.1 time: 0.030144 Jul 21 08:41:11.199402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 531/1055] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:41:11 2022] DELETE /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:11.203886 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:11.204500 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 22ccd8f3-1c61-4d7f-a676-a02e40775524] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:11.210970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:11.211454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:11.212221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:11.212656 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:11.226180 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 HTTP/1.1 Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:41:11.227708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.229309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '22ccd8f3-1c61-4d7f-a676-a02e40775524'} Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:11.230247 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. Jul 21 08:41:11.231772 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:11.233115 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance 22ccd8f3-1c61-4d7f-a676-a02e40775524 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:11.233115 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5404088a-d38b-43ac-99d5-e32fa94dab32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524" status: 404 len: 111 microversion: 2.1 time: 0.029137 Jul 21 08:41:11.233115 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 525/1056] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:11 2022] GET /compute/v2.1/servers/22ccd8f3-1c61-4d7f-a676-a02e40775524 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:11.381023 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2104e164-676a-4e81-9f73-f44a092f4a81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:11.381541 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2104e164-676a-4e81-9f73-f44a092f4a81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:11.388486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2104e164-676a-4e81-9f73-f44a092f4a81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:11.388985 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2104e164-676a-4e81-9f73-f44a092f4a81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:11.389717 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2104e164-676a-4e81-9f73-f44a092f4a81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:11.391045 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2104e164-676a-4e81-9f73-f44a092f4a81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:11.529792 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2104e164-676a-4e81-9f73-f44a092f4a81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:11.538595 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2104e164-676a-4e81-9f73-f44a092f4a81 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.162074 Jul 21 08:41:11.539399 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 532/1057] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:11 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:12.287514 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-112aba78-62bc-451b-ad19-181a549f9d30 req-a2a1ba2b-ddbe-4e87-9e47-5a9998d525bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63adf61f-e7b5-40ce-aa64-750a939dd7f9", "name": "network-vif-plugged", "status": "completed", "tag": "a0642deb-22b8-49a7-8de3-19807381ac26"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:41:12.292628 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:12.300043 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-112aba78-62bc-451b-ad19-181a549f9d30 req-a2a1ba2b-ddbe-4e87-9e47-5a9998d525bf service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.300662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-112aba78-62bc-451b-ad19-181a549f9d30 req-a2a1ba2b-ddbe-4e87-9e47-5a9998d525bf service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.315812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-112aba78-62bc-451b-ad19-181a549f9d30 req-a2a1ba2b-ddbe-4e87-9e47-5a9998d525bf service nova] Creating event network-vif-plugged:a0642deb-22b8-49a7-8de3-19807381ac26 for instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 on hv-cinder-85032 Jul 21 08:41:12.320778 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-112aba78-62bc-451b-ad19-181a549f9d30 req-a2a1ba2b-ddbe-4e87-9e47-5a9998d525bf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036985 Jul 21 08:41:12.321595 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 526/1058] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:12.370768 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:12.371294 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:12.373237 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:12.373906 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:12.382524 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.383007 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.383801 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.384239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.399825 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff HTTP/1.1 Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:41:12.401412 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.403099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'e02a2f09-54d5-4788-800e-d2e7e3de4fff'} Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:12.404993 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.406603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.408167 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:12.408167 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-94c98840-1f67-4539-88a6-5c5b5181932d tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 404 len: 111 microversion: 2.1 time: 0.036703 Jul 21 08:41:12.408167 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 533/1059] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:41:12 2022] DELETE /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:12.411616 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:12.412319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: e02a2f09-54d5-4788-800e-d2e7e3de4fff] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:12.418953 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.419459 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.420237 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.420670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.435081 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff HTTP/1.1 Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:41:12.436774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.438443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'e02a2f09-54d5-4788-800e-d2e7e3de4fff'} Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:12.439878 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. Jul 21 08:41:12.441471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.442940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance e02a2f09-54d5-4788-800e-d2e7e3de4fff could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:12.442940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eaf77180-cfa8-485c-b51d-2f89495eec32 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff" status: 404 len: 111 microversion: 2.1 time: 0.030647 Jul 21 08:41:12.442940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 527/1060] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:12 2022] GET /compute/v2.1/servers/e02a2f09-54d5-4788-800e-d2e7e3de4fff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:12.447494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:12.448001 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:12.454572 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.455056 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.456110 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.456570 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.470274 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 HTTP/1.1 Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:41:12.471778 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.473107 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '879c0ce7-ad97-44ce-96fd-b8bbb721f271'} Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:12.473853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.475588 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.477263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:12.477263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e24157b6-7e2c-4505-b848-6ab98351f6c6 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 404 len: 111 microversion: 2.1 time: 0.029793 Jul 21 08:41:12.477263 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 534/1061] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:41:12 2022] DELETE /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:12.482911 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:12.483554 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: 879c0ce7-ad97-44ce-96fd-b8bbb721f271] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:12.490281 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.490719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.491702 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.492126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.508423 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 HTTP/1.1 Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:41:12.509515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.511138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '879c0ce7-ad97-44ce-96fd-b8bbb721f271'} Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:12.512689 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. Jul 21 08:41:12.514110 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:12.515529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance 879c0ce7-ad97-44ce-96fd-b8bbb721f271 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:12.515529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c222c4f-222e-4c95-9e55-48e9bb6801d2 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271" status: 404 len: 111 microversion: 2.1 time: 0.031929 Jul 21 08:41:12.515529 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 528/1062] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:12 2022] GET /compute/v2.1/servers/879c0ce7-ad97-44ce-96fd-b8bbb721f271 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:12.555776 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9a2a91cf-680d-4e7a-be42-c39a444811d5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:12.556267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9a2a91cf-680d-4e7a-be42-c39a444811d5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:12.562363 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a2a91cf-680d-4e7a-be42-c39a444811d5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.562878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a2a91cf-680d-4e7a-be42-c39a444811d5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.563641 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a2a91cf-680d-4e7a-be42-c39a444811d5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:12.564105 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a2a91cf-680d-4e7a-be42-c39a444811d5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:12.697117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9a2a91cf-680d-4e7a-be42-c39a444811d5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:12.704428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9a2a91cf-680d-4e7a-be42-c39a444811d5 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.152797 Jul 21 08:41:12.704985 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 535/1063] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:12 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:13.656402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:13.656891 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:13.663401 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:13.663855 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:13.664621 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:13.665061 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:13.678261 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 HTTP/1.1 Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:41:13.679867 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.681569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': 'da9b5c0f-6620-4aaf-bc46-be3c69cd4145'} Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:13.682397 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.683670 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.685267 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:13.685267 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3abd7b51-8294-4b34-b95b-11c76f493177 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "DELETE /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 404 len: 111 microversion: 2.1 time: 0.028783 Jul 21 08:41:13.685267 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 529/1064] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:41:13 2022] DELETE /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:13.690876 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:13.691643 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] [instance: da9b5c0f-6620-4aaf-bc46-be3c69cd4145] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:13.698303 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:13.698786 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:13.699582 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:13.700047 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:13.713909 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] HTTP exception thrown: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Request method failure captured: Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 HTTP/1.1 Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RAHuQd6cpW5Rveb9_z0kgiafQe9hNS5XBs8-PbZd8RvbJcccu89rDBSUC31Tmi1ZD_qBMABeGvmRlY-lzM0KCQ3Cgnhu9qwTTwQgvCCv9Q9vxRRoZ877slda2tc_KWWOgO1g1DvjpSMP4xw3qxe_cTTOSGlbZVKS7FEvaUxZfYbX-M Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:41:13.715463 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ca704726a8064214b0507190fe51650f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ca704726a8064214b0507190fe51650f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ca704726a8064214b0507190fe51650f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ca704726a8064214b0507190fe51650f Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-114911477 Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 7baa0b2ddca4431b8d006873ca90ab2c Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-114911477-project Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.717462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': 'da9b5c0f-6620-4aaf-bc46-be3c69cd4145'} Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:41:13.718400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. Jul 21 08:41:13.719919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:41:13.721258 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] Returning 404 to user: Instance da9b5c0f-6620-4aaf-bc46-be3c69cd4145 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:41:13.721258 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a7536a1a-1db9-4bca-9d4b-6b770679d972 tempest-AttachVolumeNegativeTest-114911477 tempest-AttachVolumeNegativeTest-114911477-project] 10.222.0.47 "GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145" status: 404 len: 111 microversion: 2.1 time: 0.031176 Jul 21 08:41:13.721258 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 536/1065] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:13 2022] GET /compute/v2.1/servers/da9b5c0f-6620-4aaf-bc46-be3c69cd4145 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 08:41:13.721518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-57709c5a-4efc-4a8b-be24-624eab6951a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:13.722171 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-57709c5a-4efc-4a8b-be24-624eab6951a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:13.727749 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57709c5a-4efc-4a8b-be24-624eab6951a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:13.728188 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57709c5a-4efc-4a8b-be24-624eab6951a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:13.728947 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57709c5a-4efc-4a8b-be24-624eab6951a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:13.729375 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57709c5a-4efc-4a8b-be24-624eab6951a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:13.747465 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:13.861942 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-57709c5a-4efc-4a8b-be24-624eab6951a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:13.869588 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-57709c5a-4efc-4a8b-be24-624eab6951a8 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1363 microversion: 2.1 time: 0.152327 Jul 21 08:41:13.870174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 530/1066] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:13 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:41:14.887639 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-edf6d704-954b-48b2-98c7-941a01b7b7a9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:14.888201 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-edf6d704-954b-48b2-98c7-941a01b7b7a9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:14.895182 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edf6d704-954b-48b2-98c7-941a01b7b7a9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:14.895735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edf6d704-954b-48b2-98c7-941a01b7b7a9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:14.896509 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edf6d704-954b-48b2-98c7-941a01b7b7a9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:14.896950 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edf6d704-954b-48b2-98c7-941a01b7b7a9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:15.089400 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-edf6d704-954b-48b2-98c7-941a01b7b7a9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:41:15.096862 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-edf6d704-954b-48b2-98c7-941a01b7b7a9 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1549 microversion: 2.1 time: 0.213249 Jul 21 08:41:15.097628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 537/1067] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:41:14 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1549 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:41:15.112902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd92d582-16d2-4cd2-a873-d6183eab19e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:15.114049 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd92d582-16d2-4cd2-a873-d6183eab19e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:15.120624 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd92d582-16d2-4cd2-a873-d6183eab19e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:15.121073 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd92d582-16d2-4cd2-a873-d6183eab19e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:15.121844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd92d582-16d2-4cd2-a873-d6183eab19e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:15.122281 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd92d582-16d2-4cd2-a873-d6183eab19e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:15.207643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd92d582-16d2-4cd2-a873-d6183eab19e2 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098607 Jul 21 08:41:15.208235 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 531/1068] 10.222.0.47 () {58 vars in 1274 bytes} [Thu Jul 21 08:41:15 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:16.265341 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-43cc897c-e994-48e7-8895-0db9bf484006 req-9af869bb-24f4-4018-b5c0-8534fd0c6ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63adf61f-e7b5-40ce-aa64-750a939dd7f9", "tag": "a0642deb-22b8-49a7-8de3-19807381ac26"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:41:16.282242 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-43cc897c-e994-48e7-8895-0db9bf484006 req-9af869bb-24f4-4018-b5c0-8534fd0c6ec0 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:16.282735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-43cc897c-e994-48e7-8895-0db9bf484006 req-9af869bb-24f4-4018-b5c0-8534fd0c6ec0 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:16.295099 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-43cc897c-e994-48e7-8895-0db9bf484006 req-9af869bb-24f4-4018-b5c0-8534fd0c6ec0 service nova] Creating event network-changed:a0642deb-22b8-49a7-8de3-19807381ac26 for instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 on hv-cinder-85032 Jul 21 08:41:16.301486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-43cc897c-e994-48e7-8895-0db9bf484006 req-9af869bb-24f4-4018-b5c0-8534fd0c6ec0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039554 Jul 21 08:41:16.302508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 538/1069] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:48.064460 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:48.065205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:48.068998 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ace56ece-4275-48cd-9b38-48203353265e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:48.069482 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ace56ece-4275-48cd-9b38-48203353265e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:48.076436 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ace56ece-4275-48cd-9b38-48203353265e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:48.076844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ace56ece-4275-48cd-9b38-48203353265e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:48.077594 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ace56ece-4275-48cd-9b38-48203353265e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:48.078017 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ace56ece-4275-48cd-9b38-48203353265e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:48.102768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ace56ece-4275-48cd-9b38-48203353265e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/ips" status: 200 len: 146 microversion: 2.1 time: 0.040295 Jul 21 08:41:48.103344 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 532/1070] 10.222.0.47 () {58 vars in 1247 bytes} [Thu Jul 21 08:41:48 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:49.415662 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:49.416462 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:49.421728 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a259b60a-9b21-4f81-8d38-3694b86b994a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0632a97e-2472-4ca0-983d-3338ba061cc3"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:41:49.422932 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a259b60a-9b21-4f81-8d38-3694b86b994a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:49.438530 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a259b60a-9b21-4f81-8d38-3694b86b994a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:49.438988 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a259b60a-9b21-4f81-8d38-3694b86b994a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:49.439853 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a259b60a-9b21-4f81-8d38-3694b86b994a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:49.440296 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a259b60a-9b21-4f81-8d38-3694b86b994a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:49.689739 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a259b60a-9b21-4f81-8d38-3694b86b994a tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275243 Jul 21 08:41:49.695085 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 539/1071] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:41:49 2022] POST /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:56.139274 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-999bbbbe-31f9-4ad1-aec9-006c289900f4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:56.140233 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-999bbbbe-31f9-4ad1-aec9-006c289900f4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:56.146729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-999bbbbe-31f9-4ad1-aec9-006c289900f4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:56.147172 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-999bbbbe-31f9-4ad1-aec9-006c289900f4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:56.147964 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-999bbbbe-31f9-4ad1-aec9-006c289900f4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:56.148396 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-999bbbbe-31f9-4ad1-aec9-006c289900f4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:56.177359 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-999bbbbe-31f9-4ad1-aec9-006c289900f4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Jul 21 08:41:56.177908 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 533/1072] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:41:56 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:56.188690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d71af3d1-6564-46d5-8e76-ae54aed7bf47 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:41:56.189272 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d71af3d1-6564-46d5-8e76-ae54aed7bf47 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:56.195492 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d71af3d1-6564-46d5-8e76-ae54aed7bf47 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:56.195946 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d71af3d1-6564-46d5-8e76-ae54aed7bf47 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:56.196716 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d71af3d1-6564-46d5-8e76-ae54aed7bf47 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:56.197160 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d71af3d1-6564-46d5-8e76-ae54aed7bf47 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:56.225550 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d71af3d1-6564-46d5-8e76-ae54aed7bf47 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/0632a97e-2472-4ca0-983d-3338ba061cc3" status: 200 len: 194 microversion: 2.1 time: 0.041602 Jul 21 08:41:56.226141 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 540/1073] 10.222.0.47 () {58 vars in 1412 bytes} [Thu Jul 21 08:41:56 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/0632a97e-2472-4ca0-983d-3338ba061cc3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:41:57.543090 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bf30f77f-b784-439c-83a4-1189d5a80270 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44249687-f523-4fda-8b33-d11d0fd243b1"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:41:57.544190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bf30f77f-b784-439c-83a4-1189d5a80270 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:41:57.551214 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf30f77f-b784-439c-83a4-1189d5a80270 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:57.551687 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf30f77f-b784-439c-83a4-1189d5a80270 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:57.552451 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf30f77f-b784-439c-83a4-1189d5a80270 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:41:57.552886 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf30f77f-b784-439c-83a4-1189d5a80270 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:41:57.793687 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bf30f77f-b784-439c-83a4-1189d5a80270 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "POST /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255271 Jul 21 08:41:57.794303 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 534/1074] 10.222.0.47 () {60 vars in 1322 bytes} [Thu Jul 21 08:41:57 2022] POST /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:14.778827 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a8fe0e6-ca4b-4c61-b3b6-b39df3512a75 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:14.779919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3a8fe0e6-ca4b-4c61-b3b6-b39df3512a75 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:14.782621 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:14.783293 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:14.789181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a8fe0e6-ca4b-4c61-b3b6-b39df3512a75 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:14.789631 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a8fe0e6-ca4b-4c61-b3b6-b39df3512a75 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:14.790403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a8fe0e6-ca4b-4c61-b3b6-b39df3512a75 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:14.790844 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a8fe0e6-ca4b-4c61-b3b6-b39df3512a75 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:14.822602 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3a8fe0e6-ca4b-4c61-b3b6-b39df3512a75 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047826 Jul 21 08:42:14.823161 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 541/1075] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:42:14 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:14.966858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cbb63878-5c95-4734-88c1-fe84b8c7fc63 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:14.967651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cbb63878-5c95-4734-88c1-fe84b8c7fc63 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:14.970477 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:14.971246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:14.980731 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbb63878-5c95-4734-88c1-fe84b8c7fc63 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:14.981199 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbb63878-5c95-4734-88c1-fe84b8c7fc63 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:14.981965 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbb63878-5c95-4734-88c1-fe84b8c7fc63 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:14.982404 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbb63878-5c95-4734-88c1-fe84b8c7fc63 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:15.013857 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cbb63878-5c95-4734-88c1-fe84b8c7fc63 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/0632a97e-2472-4ca0-983d-3338ba061cc3" status: 200 len: 194 microversion: 2.1 time: 0.051619 Jul 21 08:42:15.014459 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 535/1076] 10.222.0.47 () {58 vars in 1412 bytes} [Thu Jul 21 08:42:14 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/0632a97e-2472-4ca0-983d-3338ba061cc3 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:15.024734 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-239ab705-47fe-4c56-a2a4-35c86ae6d3ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:15.025296 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-239ab705-47fe-4c56-a2a4-35c86ae6d3ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:15.031233 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-239ab705-47fe-4c56-a2a4-35c86ae6d3ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:15.031714 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-239ab705-47fe-4c56-a2a4-35c86ae6d3ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:15.032479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-239ab705-47fe-4c56-a2a4-35c86ae6d3ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:15.032918 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-239ab705-47fe-4c56-a2a4-35c86ae6d3ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:15.114014 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-239ab705-47fe-4c56-a2a4-35c86ae6d3ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lazy-loading 'services' on Instance uuid 63adf61f-e7b5-40ce-aa64-750a939dd7f9 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:42:15.186820 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-239ab705-47fe-4c56-a2a4-35c86ae6d3ff tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/0632a97e-2472-4ca0-983d-3338ba061cc3" status: 202 len: 0 microversion: 2.1 time: 0.166262 Jul 21 08:42:15.187429 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 542/1077] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:42:15 2022] DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/0632a97e-2472-4ca0-983d-3338ba061cc3 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:42:16.306334 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6dede1bc-da60-412c-9685-16dab8d95d79 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:16.306906 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6dede1bc-da60-412c-9685-16dab8d95d79 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:16.313902 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dede1bc-da60-412c-9685-16dab8d95d79 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:16.314333 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dede1bc-da60-412c-9685-16dab8d95d79 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:16.315096 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dede1bc-da60-412c-9685-16dab8d95d79 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:16.315558 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dede1bc-da60-412c-9685-16dab8d95d79 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:16.346949 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6dede1bc-da60-412c-9685-16dab8d95d79 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/44249687-f523-4fda-8b33-d11d0fd243b1" status: 200 len: 194 microversion: 2.1 time: 0.044642 Jul 21 08:42:16.347568 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 536/1078] 10.222.0.47 () {58 vars in 1412 bytes} [Thu Jul 21 08:42:16 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/44249687-f523-4fda-8b33-d11d0fd243b1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:16.358826 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-511369db-2a83-4632-8ddc-3a08f030f9cd tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:16.359424 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-511369db-2a83-4632-8ddc-3a08f030f9cd tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:16.365636 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-511369db-2a83-4632-8ddc-3a08f030f9cd tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:16.366077 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-511369db-2a83-4632-8ddc-3a08f030f9cd tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:16.366883 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-511369db-2a83-4632-8ddc-3a08f030f9cd tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:16.367258 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-511369db-2a83-4632-8ddc-3a08f030f9cd tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:16.447753 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-511369db-2a83-4632-8ddc-3a08f030f9cd tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lazy-loading 'services' on Instance uuid 63adf61f-e7b5-40ce-aa64-750a939dd7f9 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:42:16.521508 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-511369db-2a83-4632-8ddc-3a08f030f9cd tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/44249687-f523-4fda-8b33-d11d0fd243b1" status: 202 len: 0 microversion: 2.1 time: 0.167774 Jul 21 08:42:16.522102 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 543/1079] 10.222.0.47 () {58 vars in 1415 bytes} [Thu Jul 21 08:42:16 2022] DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments/44249687-f523-4fda-8b33-d11d0fd243b1 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:42:17.683108 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-089349b1-ad6e-4371-b195-44ff5f69a74e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:17.684167 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-089349b1-ad6e-4371-b195-44ff5f69a74e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:17.692106 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-089349b1-ad6e-4371-b195-44ff5f69a74e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:17.692553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-089349b1-ad6e-4371-b195-44ff5f69a74e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:17.693323 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-089349b1-ad6e-4371-b195-44ff5f69a74e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:17.693759 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-089349b1-ad6e-4371-b195-44ff5f69a74e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:17.724513 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-089349b1-ad6e-4371-b195-44ff5f69a74e tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045727 Jul 21 08:42:17.724996 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 537/1080] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:42:17 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:42:17.832104 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ff4ef1d7-fd1c-404a-97f9-6d7fc171dbba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:17.833117 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ff4ef1d7-fd1c-404a-97f9-6d7fc171dbba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:17.839594 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff4ef1d7-fd1c-404a-97f9-6d7fc171dbba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:17.840152 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff4ef1d7-fd1c-404a-97f9-6d7fc171dbba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:17.840944 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff4ef1d7-fd1c-404a-97f9-6d7fc171dbba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:17.841389 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff4ef1d7-fd1c-404a-97f9-6d7fc171dbba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:17.876559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ff4ef1d7-fd1c-404a-97f9-6d7fc171dbba tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049305 Jul 21 08:42:17.877866 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 544/1081] 10.222.0.47 () {58 vars in 1301 bytes} [Thu Jul 21 08:42:17 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 08:42:17.937207 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ea78a9e-4060-40dc-b0d8-f20d304e5cc6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:17.937704 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ea78a9e-4060-40dc-b0d8-f20d304e5cc6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:17.943655 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ea78a9e-4060-40dc-b0d8-f20d304e5cc6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:17.944092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ea78a9e-4060-40dc-b0d8-f20d304e5cc6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:17.944842 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ea78a9e-4060-40dc-b0d8-f20d304e5cc6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:17.945269 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ea78a9e-4060-40dc-b0d8-f20d304e5cc6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:17.969057 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ea78a9e-4060-40dc-b0d8-f20d304e5cc6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:42:18.042012 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ea78a9e-4060-40dc-b0d8-f20d304e5cc6 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 204 len: 0 microversion: 2.1 time: 0.108788 Jul 21 08:42:18.042584 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 538/1082] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:42:17 2022] DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:42:18.054368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4282f25d-7322-48c0-819c-7565096ec8de tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:18.055059 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4282f25d-7322-48c0-819c-7565096ec8de tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:18.062331 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4282f25d-7322-48c0-819c-7565096ec8de tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:18.062785 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4282f25d-7322-48c0-819c-7565096ec8de tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:18.063688 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4282f25d-7322-48c0-819c-7565096ec8de tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:18.064131 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4282f25d-7322-48c0-819c-7565096ec8de tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:18.202136 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4282f25d-7322-48c0-819c-7565096ec8de tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:42:18.212134 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4282f25d-7322-48c0-819c-7565096ec8de tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1674 microversion: 2.1 time: 0.164019 Jul 21 08:42:18.212706 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 545/1083] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:42:18 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:19.230621 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-33f259be-3be2-4c9a-943e-4f501a1f946d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:19.231319 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-33f259be-3be2-4c9a-943e-4f501a1f946d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:19.238426 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33f259be-3be2-4c9a-943e-4f501a1f946d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:19.238872 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33f259be-3be2-4c9a-943e-4f501a1f946d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:19.239674 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33f259be-3be2-4c9a-943e-4f501a1f946d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:19.240113 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33f259be-3be2-4c9a-943e-4f501a1f946d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:19.371412 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33f259be-3be2-4c9a-943e-4f501a1f946d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:42:19.379928 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-33f259be-3be2-4c9a-943e-4f501a1f946d tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1674 microversion: 2.1 time: 0.153357 Jul 21 08:42:19.380488 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 539/1084] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:42:19 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:20.396831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9ad577a0-8610-4dcf-99b0-5cc81fe66747 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:20.397450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9ad577a0-8610-4dcf-99b0-5cc81fe66747 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:20.404009 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ad577a0-8610-4dcf-99b0-5cc81fe66747 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:20.404468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ad577a0-8610-4dcf-99b0-5cc81fe66747 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:20.405759 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ad577a0-8610-4dcf-99b0-5cc81fe66747 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:20.406204 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ad577a0-8610-4dcf-99b0-5cc81fe66747 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:20.535532 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9ad577a0-8610-4dcf-99b0-5cc81fe66747 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:42:20.543000 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9ad577a0-8610-4dcf-99b0-5cc81fe66747 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1674 microversion: 2.1 time: 0.150128 Jul 21 08:42:20.543597 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 546/1085] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:42:20 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:21.562875 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05e2a70f-ec17-4605-94c5-edcf516aef33 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:21.563882 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05e2a70f-ec17-4605-94c5-edcf516aef33 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:21.571441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05e2a70f-ec17-4605-94c5-edcf516aef33 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:21.571881 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05e2a70f-ec17-4605-94c5-edcf516aef33 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:21.572868 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05e2a70f-ec17-4605-94c5-edcf516aef33 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:21.573326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05e2a70f-ec17-4605-94c5-edcf516aef33 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:21.698225 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05e2a70f-ec17-4605-94c5-edcf516aef33 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:42:21.705949 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05e2a70f-ec17-4605-94c5-edcf516aef33 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1674 microversion: 2.1 time: 0.148739 Jul 21 08:42:21.706513 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 540/1086] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:42:21 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:22.723782 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c26bd97-54ec-43fa-be21-cf05814f4390 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:22.724512 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c26bd97-54ec-43fa-be21-cf05814f4390 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:22.731090 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c26bd97-54ec-43fa-be21-cf05814f4390 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:22.731568 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c26bd97-54ec-43fa-be21-cf05814f4390 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:22.732330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c26bd97-54ec-43fa-be21-cf05814f4390 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:22.732755 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c26bd97-54ec-43fa-be21-cf05814f4390 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:22.795388 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c26bd97-54ec-43fa-be21-cf05814f4390 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '591ec12e19db47139d3a73484abf2f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd588f87ef1d248528ec37cd9b5d43dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:42:22.803168 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c26bd97-54ec-43fa-be21-cf05814f4390 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 200 len: 1607 microversion: 2.1 time: 0.083391 Jul 21 08:42:22.803786 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 547/1087] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:42:22 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 1607 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:22.942794 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-00cad24d-256b-4957-aee9-eefd0a41cde1 req-7f455c7c-d780-40a1-ba59-ccadd1745ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63adf61f-e7b5-40ce-aa64-750a939dd7f9", "name": "network-vif-deleted", "tag": "a0642deb-22b8-49a7-8de3-19807381ac26"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:42:22.956281 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-00cad24d-256b-4957-aee9-eefd0a41cde1 req-7f455c7c-d780-40a1-ba59-ccadd1745ba9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:22.956802 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-00cad24d-256b-4957-aee9-eefd0a41cde1 req-7f455c7c-d780-40a1-ba59-ccadd1745ba9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:22.969709 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-00cad24d-256b-4957-aee9-eefd0a41cde1 req-7f455c7c-d780-40a1-ba59-ccadd1745ba9 service nova] Creating event network-vif-deleted:a0642deb-22b8-49a7-8de3-19807381ac26 for instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 on hv-cinder-85032 Jul 21 08:42:22.975310 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-00cad24d-256b-4957-aee9-eefd0a41cde1 req-7f455c7c-d780-40a1-ba59-ccadd1745ba9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037822 Jul 21 08:42:22.977348 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 541/1088] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:23.821779 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:23.822534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:23.829874 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:23.830323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:23.831108 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:23.831590 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:23.846114 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] HTTP exception thrown: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Request method failure captured: Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 HTTP/1.1 Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RB38futWQgL4o87Q1TFTFIRhyNjhd7MGEfCywTh5k-Vr8wDoXUOyHbHK7aNaBIHJAykGHP8dDsZ__IZ3Pskg8s-Cgcng5WmMwThBRFwJqC90SO9aNAAiwbOGb7Bu3RFAE8_52GCNxHIB6JtdIYyR718XoANduX0dYB4ib1T3Tlp-wo Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:42:23.847845 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 591ec12e19db47139d3a73484abf2f0d Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:23.849517 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '63adf61f-e7b5-40ce-aa64-750a939dd7f9'} Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:42:23.850450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:23.851870 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:23.853088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Returning 404 to user: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:42:23.853088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d99ea633-b5ec-447b-a8b7-ca09a470f99f tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 404 len: 111 microversion: 2.1 time: 0.032196 Jul 21 08:42:23.853088 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 548/1089] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:42:23 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:42:23.859604 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27cd1b4f-db78-44c9-98d7-93a5e22a54a4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '.version_select at 0x7f65bc8ab430>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:23.878317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27cd1b4f-db78-44c9-98d7-93a5e22a54a4 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178891718" status: 202 len: 0 microversion: 2.1 time: 0.022975 Jul 21 08:42:23.878891 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 542/1090] 10.222.0.47 () {58 vars in 1220 bytes} [Thu Jul 21 08:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178891718 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 08:42:26.761163 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:26.761671 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:26.768380 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:26.768831 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:26.769603 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:26.770044 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:26.783528 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] HTTP exception thrown: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Request method failure captured: Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 HTTP/1.1 Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RB38futWQgL4o87Q1TFTFIRhyNjhd7MGEfCywTh5k-Vr8wDoXUOyHbHK7aNaBIHJAykGHP8dDsZ__IZ3Pskg8s-Cgcng5WmMwThBRFwJqC90SO9aNAAiwbOGb7Bu3RFAE8_52GCNxHIB6JtdIYyR718XoANduX0dYB4ib1T3Tlp-wo Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:42:26.785071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 591ec12e19db47139d3a73484abf2f0d Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.786738 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '63adf61f-e7b5-40ce-aa64-750a939dd7f9'} Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:42:26.787679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.789162 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.790632 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Returning 404 to user: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:42:26.790632 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-85d0e565-f3ee-4532-a9bd-ca34e98d0798 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 404 len: 111 microversion: 2.1 time: 0.029106 Jul 21 08:42:26.790632 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 549/1091] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:42:26 2022] DELETE /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:42:26.796126 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:26.796858 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 63adf61f-e7b5-40ce-aa64-750a939dd7f9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:26.803138 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:26.803634 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:26.804394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:26.804833 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:26.818617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] HTTP exception thrown: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Request method failure captured: Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 HTTP/1.1 Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RB38futWQgL4o87Q1TFTFIRhyNjhd7MGEfCywTh5k-Vr8wDoXUOyHbHK7aNaBIHJAykGHP8dDsZ__IZ3Pskg8s-Cgcng5WmMwThBRFwJqC90SO9aNAAiwbOGb7Bu3RFAE8_52GCNxHIB6JtdIYyR718XoANduX0dYB4ib1T3Tlp-wo Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:42:26.820246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 591ec12e19db47139d3a73484abf2f0d Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.821824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '63adf61f-e7b5-40ce-aa64-750a939dd7f9'} Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:42:26.822699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. Jul 21 08:42:26.824300 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:26.825575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Returning 404 to user: Instance 63adf61f-e7b5-40ce-aa64-750a939dd7f9 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:42:26.825575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-83b235a5-35b6-40c8-b02a-6a979dbf2fdf tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9" status: 404 len: 111 microversion: 2.1 time: 0.030560 Jul 21 08:42:26.825575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 543/1092] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:42:26 2022] GET /compute/v2.1/servers/63adf61f-e7b5-40ce-aa64-750a939dd7f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:42:27.960170 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:27.960670 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:27.967201 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:27.967719 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:27.969052 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:27.969052 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:27.983125 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] HTTP exception thrown: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Request method failure captured: Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 HTTP/1.1 Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RB38futWQgL4o87Q1TFTFIRhyNjhd7MGEfCywTh5k-Vr8wDoXUOyHbHK7aNaBIHJAykGHP8dDsZ__IZ3Pskg8s-Cgcng5WmMwThBRFwJqC90SO9aNAAiwbOGb7Bu3RFAE8_52GCNxHIB6JtdIYyR718XoANduX0dYB4ib1T3Tlp-wo Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:42:27.984735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 591ec12e19db47139d3a73484abf2f0d Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:27.986330 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '4765bcf7-c1c0-48bc-92d9-2d6b53cad403'} Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:42:27.987234 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:27.988987 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:42:27.990583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Returning 404 to user: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:42:27.990583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a16ffd11-8097-4afe-a194-56edff2a3811 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 404 len: 111 microversion: 2.1 time: 0.029863 Jul 21 08:42:27.990583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 550/1093] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:42:27 2022] DELETE /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:42:27.994578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:27.995190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] [instance: 4765bcf7-c1c0-48bc-92d9-2d6b53cad403] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:42:28.002508 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:28.002955 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:28.003746 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:42:28.004183 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:42:28.018724 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] HTTP exception thrown: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Request method failure captured: Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 HTTP/1.1 Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RB38futWQgL4o87Q1TFTFIRhyNjhd7MGEfCywTh5k-Vr8wDoXUOyHbHK7aNaBIHJAykGHP8dDsZ__IZ3Pskg8s-Cgcng5WmMwThBRFwJqC90SO9aNAAiwbOGb7Bu3RFAE8_52GCNxHIB6JtdIYyR718XoANduX0dYB4ib1T3Tlp-wo Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:42:28.020257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d588f87ef1d248528ec37cd9b5d43dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d588f87ef1d248528ec37cd9b5d43dcc Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-150236641 Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 591ec12e19db47139d3a73484abf2f0d Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeTestJSON-150236641-project Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:28.021885 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '4765bcf7-c1c0-48bc-92d9-2d6b53cad403'} Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:42:28.022782 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. Jul 21 08:42:28.024342 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:42:28.025997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] Returning 404 to user: Instance 4765bcf7-c1c0-48bc-92d9-2d6b53cad403 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:42:28.025997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-440ecd46-b731-429f-b1b2-013677e95288 tempest-AttachVolumeTestJSON-150236641 tempest-AttachVolumeTestJSON-150236641-project] 10.222.0.47 "GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403" status: 404 len: 111 microversion: 2.1 time: 0.030901 Jul 21 08:42:28.025997 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 544/1094] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:42:27 2022] GET /compute/v2.1/servers/4765bcf7-c1c0-48bc-92d9-2d6b53cad403 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:42:33.620900 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-76766cd3-ce3b-422a-ae69-ba8d2fcdc325 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65bc3a5160>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:33.677511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-76766cd3-ce3b-422a-ae69-ba8d2fcdc325 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e3f70471-9a2c-4bf3-8772-38751119f967" status: 200 len: 350 microversion: 2.1 time: 0.060487 Jul 21 08:42:33.678268 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 551/1095] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:42:33 2022] GET /compute/v2.1/os-volumes/e3f70471-9a2c-4bf3-8772-38751119f967 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:35.002632 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f692d862-ae59-437c-8714-88bf5ecf64ee tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65bc6fbf70>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:35.052435 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f692d862-ae59-437c-8714-88bf5ecf64ee tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/470ef402-83f9-49c8-ba98-7ebcf854a39b" status: 200 len: 351 microversion: 2.1 time: 0.053702 Jul 21 08:42:35.053092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 545/1096] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:42:34 2022] GET /compute/v2.1/os-volumes/470ef402-83f9-49c8-ba98-7ebcf854a39b => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:36.385759 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6176a076-5b5d-46be-ad9a-533f1257e4e9 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65bc438b80>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:36.434132 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6176a076-5b5d-46be-ad9a-533f1257e4e9 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/5edc71f0-6026-4006-968f-2afb8df98fce" status: 200 len: 350 microversion: 2.1 time: 0.052328 Jul 21 08:42:36.434764 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 552/1097] 10.222.0.47 () {58 vars in 1244 bytes} [Thu Jul 21 08:42:36 2022] GET /compute/v2.1/os-volumes/5edc71f0-6026-4006-968f-2afb8df98fce => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:36.446383 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-186236fa-2d41-42de-993e-73ab31ef1ed4 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65c0b32a60>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:36.529403 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-186236fa-2d41-42de-993e-73ab31ef1ed4 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087214 Jul 21 08:42:36.530684 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 546/1098] 10.222.0.47 () {58 vars in 1133 bytes} [Thu Jul 21 08:42:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:36.543444 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e1b10bf5-475c-45a7-aa9a-921f0b1f00cd tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65bc3a51f0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:36.626715 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e1b10bf5-475c-45a7-aa9a-921f0b1f00cd tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087476 Jul 21 08:42:36.627572 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 553/1099] 10.222.0.47 () {58 vars in 1148 bytes} [Thu Jul 21 08:42:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:36.640569 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ed1f4c73-f717-4ffb-8359-95cc5668b79c tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65bc4e6a60>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:36.723804 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ed1f4c73-f717-4ffb-8359-95cc5668b79c tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087834 Jul 21 08:42:36.724376 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 547/1100] 10.222.0.47 () {58 vars in 1133 bytes} [Thu Jul 21 08:42:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:36.735504 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e2264a85-625b-496c-a85d-5c09648583b7 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65bc453700>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:36.817356 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e2264a85-625b-496c-a85d-5c09648583b7 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085637 Jul 21 08:42:36.817938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 554/1101] 10.222.0.47 () {58 vars in 1166 bytes} [Thu Jul 21 08:42:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:36.831518 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-49d96317-6181-4c76-bdfa-18691e103f3b tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65c0b36c10>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:36.916832 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-49d96317-6181-4c76-bdfa-18691e103f3b tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090316 Jul 21 08:42:36.917402 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 548/1102] 10.222.0.47 () {58 vars in 1169 bytes} [Thu Jul 21 08:42:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:36.929056 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-56b64332-d751-4827-a50a-fec680175a5e tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65bc438310>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:37.016674 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-56b64332-d751-4827-a50a-fec680175a5e tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091284 Jul 21 08:42:37.017262 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 555/1103] 10.222.0.47 () {58 vars in 1154 bytes} [Thu Jul 21 08:42:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:37.029418 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-78f35a4a-d617-4d66-9d8f-54e8f318b381 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65c0b321f0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:37.116954 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-78f35a4a-d617-4d66-9d8f-54e8f318b381 tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091282 Jul 21 08:42:37.117536 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 549/1104] 10.222.0.47 () {58 vars in 1187 bytes} [Thu Jul 21 08:42:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:42:37.129617 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-86e3071e-b9ba-402a-b3c5-8aaaa9ce3fce tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] Calling method '.version_select at 0x7f65bd07f4c0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:42:37.209664 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-86e3071e-b9ba-402a-b3c5-8aaaa9ce3fce tempest-VolumesTestJSON-1087879755 tempest-VolumesTestJSON-1087879755-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084047 Jul 21 08:42:37.210296 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 556/1105] 10.222.0.47 () {58 vars in 1154 bytes} [Thu Jul 21 08:42:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:42:59.287686 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:59.288360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:59.489077 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b882015-8db4-400f-a224-835ef9dd311b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Action: 'create', calling method: .version_select at 0x7f65c0b32310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-48847000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKoOgmGudBo6IkT/ZI+TdxCLxh3q4vUgqI9hhitVSkT+4izP0Qr0ekhQLrbBpbzVPLume6qn02oQxOZ9UPLA2mJuYrV8M3+s8nMpuSk9QDD4G3bpZ/IQQQ5H5mxYjtQlQ=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:42:59.504989 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-8b882015-8db4-400f-a224-835ef9dd311b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Getting quotas for project 7858221a62ef4997979bd2c376629140. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:42:59.510137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-8b882015-8db4-400f-a224-835ef9dd311b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Getting quotas for user 855719ced58a4b55b4b8d31affd62a7b and project 7858221a62ef4997979bd2c376629140. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:42:59.535468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b882015-8db4-400f-a224-835ef9dd311b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.249212 Jul 21 08:42:59.536459 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 550/1106] 10.222.0.47 () {60 vars in 1158 bytes} [Thu Jul 21 08:42:59 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:42:59.583268 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:42:59.584051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Thu Jul 21 08:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:43:15.965758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=20 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:15.966533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:15.971017 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1666449108", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-48847000", "security_groups": [{"name": "tempest-secgroup-smoke-689971273"}], "block_device_mapping_v2": [{"uuid": "5e9c3bbc-abcf-47c5-9083-5b38d9f679c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cda42cb-310c-4f74-8948-81ed402cc1f6"}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:43:16.081795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] validate_networks() for [('3cda42cb-310c-4f74-8948-81ed402cc1f6', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:43:16.539600 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:43:16.540029 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:43:16.540534 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:43:16.540945 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:43:16.541359 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:43:16.550352 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:16.550799 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:16.551630 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:16.552071 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:16.570872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Getting quotas for project 7858221a62ef4997979bd2c376629140. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:43:16.575348 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Getting quotas for user 855719ced58a4b55b4b8d31affd62a7b and project 7858221a62ef4997979bd2c376629140. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:43:16.631567 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:43:16.633660 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e9c3bbc-abcf-47c5-9083-5b38d9f679c9',volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:43:16.757771 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-362dccd0-21a1-4066-9a41-2c2e3581c90a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793238 Jul 21 08:43:16.758591 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 557/1107] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:43:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:43:16.766622 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:16.767560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:16.771524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1454825f-91f8-4d5d-a2d9-ded3276d218f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:16.772127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1454825f-91f8-4d5d-a2d9-ded3276d218f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:16.828350 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1454825f-91f8-4d5d-a2d9-ded3276d218f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:16.835008 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1454825f-91f8-4d5d-a2d9-ded3276d218f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1093 microversion: 2.1 time: 0.069721 Jul 21 08:43:16.835968 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 551/1108] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:16 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:17.852914 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cdd651d6-e895-4d1c-88de-8d3e1b52d740 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:17.853600 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cdd651d6-e895-4d1c-88de-8d3e1b52d740 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:17.860335 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdd651d6-e895-4d1c-88de-8d3e1b52d740 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:17.860785 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdd651d6-e895-4d1c-88de-8d3e1b52d740 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:17.861604 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdd651d6-e895-4d1c-88de-8d3e1b52d740 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:17.862043 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdd651d6-e895-4d1c-88de-8d3e1b52d740 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:17.928680 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cdd651d6-e895-4d1c-88de-8d3e1b52d740 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:17.937428 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cdd651d6-e895-4d1c-88de-8d3e1b52d740 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1209 microversion: 2.1 time: 0.088944 Jul 21 08:43:17.938017 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 558/1109] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:17 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:18.954980 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba960afe-c197-42fd-a71a-35e24ce9cdd2 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:18.956365 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba960afe-c197-42fd-a71a-35e24ce9cdd2 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:18.963062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba960afe-c197-42fd-a71a-35e24ce9cdd2 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:18.963539 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba960afe-c197-42fd-a71a-35e24ce9cdd2 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:18.964547 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba960afe-c197-42fd-a71a-35e24ce9cdd2 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:18.964972 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba960afe-c197-42fd-a71a-35e24ce9cdd2 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:19.190420 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba960afe-c197-42fd-a71a-35e24ce9cdd2 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:19.198277 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba960afe-c197-42fd-a71a-35e24ce9cdd2 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.247406 Jul 21 08:43:19.198860 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 552/1110] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:18 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:43:19.406533 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-ef7715a8-9ebe-4a8d-acf6-ebd74bce10e3 req-a3eccfbc-f1c6-444a-b37e-e5e8af80d8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7256d5-2b57-4efb-82e5-f5b4f5212957", "tag": "fd9ef0af-7935-422c-b2d2-2df96319c66b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:43:19.417130 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ef7715a8-9ebe-4a8d-acf6-ebd74bce10e3 req-a3eccfbc-f1c6-444a-b37e-e5e8af80d8dc service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:19.417581 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ef7715a8-9ebe-4a8d-acf6-ebd74bce10e3 req-a3eccfbc-f1c6-444a-b37e-e5e8af80d8dc service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:19.431255 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-ef7715a8-9ebe-4a8d-acf6-ebd74bce10e3 req-a3eccfbc-f1c6-444a-b37e-e5e8af80d8dc service nova] Creating event network-changed:fd9ef0af-7935-422c-b2d2-2df96319c66b for instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 on hv-cinder-85032 Jul 21 08:43:19.436841 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-ef7715a8-9ebe-4a8d-acf6-ebd74bce10e3 req-a3eccfbc-f1c6-444a-b37e-e5e8af80d8dc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037151 Jul 21 08:43:19.438494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 559/1111] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:43:20.215470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2fcb4e41-204a-4f9a-942d-f25f7bbb8d79 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:20.216116 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2fcb4e41-204a-4f9a-942d-f25f7bbb8d79 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:20.222664 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fcb4e41-204a-4f9a-942d-f25f7bbb8d79 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:20.223111 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fcb4e41-204a-4f9a-942d-f25f7bbb8d79 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:20.223908 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fcb4e41-204a-4f9a-942d-f25f7bbb8d79 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:20.224336 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fcb4e41-204a-4f9a-942d-f25f7bbb8d79 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:20.424495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2fcb4e41-204a-4f9a-942d-f25f7bbb8d79 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:20.431965 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2fcb4e41-204a-4f9a-942d-f25f7bbb8d79 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.220410 Jul 21 08:43:20.432541 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 553/1112] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:20 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:21.450048 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-07d0d3ef-bc35-4cfd-8baf-ad311f7afc9f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:21.450814 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-07d0d3ef-bc35-4cfd-8baf-ad311f7afc9f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:21.456951 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07d0d3ef-bc35-4cfd-8baf-ad311f7afc9f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:21.457394 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07d0d3ef-bc35-4cfd-8baf-ad311f7afc9f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:21.458142 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07d0d3ef-bc35-4cfd-8baf-ad311f7afc9f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:21.458571 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07d0d3ef-bc35-4cfd-8baf-ad311f7afc9f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:21.597155 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-07d0d3ef-bc35-4cfd-8baf-ad311f7afc9f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:21.604946 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-07d0d3ef-bc35-4cfd-8baf-ad311f7afc9f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.159536 Jul 21 08:43:21.605519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 560/1113] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:21 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:22.621712 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ccb3735a-1d4f-4546-8768-de095b92b36c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:22.622307 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ccb3735a-1d4f-4546-8768-de095b92b36c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:22.628974 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccb3735a-1d4f-4546-8768-de095b92b36c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:22.629407 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccb3735a-1d4f-4546-8768-de095b92b36c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:22.630155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccb3735a-1d4f-4546-8768-de095b92b36c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:22.630578 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccb3735a-1d4f-4546-8768-de095b92b36c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:22.759623 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ccb3735a-1d4f-4546-8768-de095b92b36c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:22.767078 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ccb3735a-1d4f-4546-8768-de095b92b36c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.149207 Jul 21 08:43:22.767676 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 554/1114] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:22 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:23.783295 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5e3653cc-5828-4e8e-86f0-e74b055ca6e7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:23.783943 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5e3653cc-5828-4e8e-86f0-e74b055ca6e7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:23.790103 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e3653cc-5828-4e8e-86f0-e74b055ca6e7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:23.790547 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e3653cc-5828-4e8e-86f0-e74b055ca6e7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:23.791312 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e3653cc-5828-4e8e-86f0-e74b055ca6e7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:23.791829 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e3653cc-5828-4e8e-86f0-e74b055ca6e7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:23.926895 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5e3653cc-5828-4e8e-86f0-e74b055ca6e7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:23.935042 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5e3653cc-5828-4e8e-86f0-e74b055ca6e7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.155622 Jul 21 08:43:23.935665 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 561/1115] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:23 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:24.952292 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e699d62-5b60-4853-9219-8237cc9ab9a9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:24.952936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e699d62-5b60-4853-9219-8237cc9ab9a9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:24.959464 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e699d62-5b60-4853-9219-8237cc9ab9a9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:24.959912 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e699d62-5b60-4853-9219-8237cc9ab9a9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:24.960674 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e699d62-5b60-4853-9219-8237cc9ab9a9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:24.961109 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e699d62-5b60-4853-9219-8237cc9ab9a9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:25.093591 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e699d62-5b60-4853-9219-8237cc9ab9a9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:25.101055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e699d62-5b60-4853-9219-8237cc9ab9a9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.153291 Jul 21 08:43:25.101623 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 555/1116] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:24 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:26.117692 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0e19e910-d066-461b-82e9-175f28b051f8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:26.118301 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0e19e910-d066-461b-82e9-175f28b051f8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:26.124820 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e19e910-d066-461b-82e9-175f28b051f8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:26.125267 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e19e910-d066-461b-82e9-175f28b051f8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:26.126029 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e19e910-d066-461b-82e9-175f28b051f8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:26.126461 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e19e910-d066-461b-82e9-175f28b051f8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:26.258239 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0e19e910-d066-461b-82e9-175f28b051f8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:26.266226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0e19e910-d066-461b-82e9-175f28b051f8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.152367 Jul 21 08:43:26.266779 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 562/1117] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:26 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:27.283699 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5dc1c649-ce4c-4358-8b85-47c1757c78f7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:27.284437 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5dc1c649-ce4c-4358-8b85-47c1757c78f7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:27.286781 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:27.292835 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5dc1c649-ce4c-4358-8b85-47c1757c78f7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:27.293821 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5dc1c649-ce4c-4358-8b85-47c1757c78f7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:27.294736 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5dc1c649-ce4c-4358-8b85-47c1757c78f7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:27.295173 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5dc1c649-ce4c-4358-8b85-47c1757c78f7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:27.425088 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5dc1c649-ce4c-4358-8b85-47c1757c78f7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:27.432353 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5dc1c649-ce4c-4358-8b85-47c1757c78f7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.152792 Jul 21 08:43:27.432919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 556/1118] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:27 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:28.448976 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5e5399dc-1ad9-487c-b9b7-e6c35bd4eb47 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:28.449593 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5e5399dc-1ad9-487c-b9b7-e6c35bd4eb47 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:28.451522 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:28.452194 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:28.458765 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e5399dc-1ad9-487c-b9b7-e6c35bd4eb47 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:28.459215 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e5399dc-1ad9-487c-b9b7-e6c35bd4eb47 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:28.460002 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e5399dc-1ad9-487c-b9b7-e6c35bd4eb47 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:28.460436 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e5399dc-1ad9-487c-b9b7-e6c35bd4eb47 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:28.597909 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5e5399dc-1ad9-487c-b9b7-e6c35bd4eb47 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:28.605326 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5e5399dc-1ad9-487c-b9b7-e6c35bd4eb47 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.160206 Jul 21 08:43:28.606446 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 563/1119] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:28 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:29.081064 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-5e1f795a-a20a-4c83-b76e-695b97697fb1 req-a8c10b3a-7299-45a9-9577-de8a6bf56474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7256d5-2b57-4efb-82e5-f5b4f5212957", "name": "network-vif-plugged", "status": "completed", "tag": "fd9ef0af-7935-422c-b2d2-2df96319c66b"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:43:29.089137 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-5e1f795a-a20a-4c83-b76e-695b97697fb1 req-a8c10b3a-7299-45a9-9577-de8a6bf56474 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:29.089575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-5e1f795a-a20a-4c83-b76e-695b97697fb1 req-a8c10b3a-7299-45a9-9577-de8a6bf56474 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:29.102914 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-5e1f795a-a20a-4c83-b76e-695b97697fb1 req-a8c10b3a-7299-45a9-9577-de8a6bf56474 service nova] Creating event network-vif-plugged:fd9ef0af-7935-422c-b2d2-2df96319c66b for instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 on hv-cinder-85032 Jul 21 08:43:29.108061 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-5e1f795a-a20a-4c83-b76e-695b97697fb1 req-a8c10b3a-7299-45a9-9577-de8a6bf56474 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150370 Jul 21 08:43:29.108644 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 557/1120] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:43:29.622047 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f79a014b-4937-43d0-833d-f07595f7d1c3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:29.622583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f79a014b-4937-43d0-833d-f07595f7d1c3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:29.629299 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f79a014b-4937-43d0-833d-f07595f7d1c3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:29.629741 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f79a014b-4937-43d0-833d-f07595f7d1c3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:29.630494 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f79a014b-4937-43d0-833d-f07595f7d1c3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:29.630928 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f79a014b-4937-43d0-833d-f07595f7d1c3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:29.764542 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f79a014b-4937-43d0-833d-f07595f7d1c3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:29.772184 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f79a014b-4937-43d0-833d-f07595f7d1c3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1264 microversion: 2.1 time: 0.154091 Jul 21 08:43:29.772872 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 564/1121] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:29 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:30.791232 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-90dde3fe-f2fa-4901-96d6-04a60c546da1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:30.791850 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-90dde3fe-f2fa-4901-96d6-04a60c546da1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:30.798601 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90dde3fe-f2fa-4901-96d6-04a60c546da1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:30.799040 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90dde3fe-f2fa-4901-96d6-04a60c546da1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:30.799820 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90dde3fe-f2fa-4901-96d6-04a60c546da1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:30.800246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90dde3fe-f2fa-4901-96d6-04a60c546da1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:30.936950 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-90dde3fe-f2fa-4901-96d6-04a60c546da1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:30.944565 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-90dde3fe-f2fa-4901-96d6-04a60c546da1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1451 microversion: 2.1 time: 0.158238 Jul 21 08:43:30.945155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 558/1122] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:30 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:30.961033 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b393ed1a-2469-43a7-9e47-eb449623a961 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:43:30.961657 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b393ed1a-2469-43a7-9e47-eb449623a961 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:43:30.969292 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b393ed1a-2469-43a7-9e47-eb449623a961 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:30.969744 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b393ed1a-2469-43a7-9e47-eb449623a961 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:30.970519 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b393ed1a-2469-43a7-9e47-eb449623a961 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:30.970962 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b393ed1a-2469-43a7-9e47-eb449623a961 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:31.104889 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b393ed1a-2469-43a7-9e47-eb449623a961 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:43:31.112966 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b393ed1a-2469-43a7-9e47-eb449623a961 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1451 microversion: 2.1 time: 0.155990 Jul 21 08:43:31.113520 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 565/1123] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:43:30 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:43:32.794222 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-b5c03ca9-b4e4-4805-8790-b2d54182b146 req-f89c2213-fc12-42d5-9dc6-9b72145820b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7256d5-2b57-4efb-82e5-f5b4f5212957", "tag": "fd9ef0af-7935-422c-b2d2-2df96319c66b"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:43:32.802683 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-b5c03ca9-b4e4-4805-8790-b2d54182b146 req-f89c2213-fc12-42d5-9dc6-9b72145820b3 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:43:32.803122 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-b5c03ca9-b4e4-4805-8790-b2d54182b146 req-f89c2213-fc12-42d5-9dc6-9b72145820b3 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:43:32.813925 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-b5c03ca9-b4e4-4805-8790-b2d54182b146 req-f89c2213-fc12-42d5-9dc6-9b72145820b3 service nova] Creating event network-changed:fd9ef0af-7935-422c-b2d2-2df96319c66b for instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 on hv-cinder-85032 Jul 21 08:43:32.818933 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-b5c03ca9-b4e4-4805-8790-b2d54182b146 req-f89c2213-fc12-42d5-9dc6-9b72145820b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028471 Jul 21 08:43:32.819665 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 559/1124] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:43:50.312870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:43:50.313554 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:45:18.758324 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:45:18.759515 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:45:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:45:25.009880 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef3f4090-1fda-4082-90a2-a99f7b11fb9c] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 08:45:25.010482 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:25.011187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=46 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:25.015414 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a4f3cfcd-e632-402e-b566-87dcc8ec1373 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:25.015952 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a4f3cfcd-e632-402e-b566-87dcc8ec1373 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:25.031423 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4f3cfcd-e632-402e-b566-87dcc8ec1373 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:25.031881 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4f3cfcd-e632-402e-b566-87dcc8ec1373 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:25.032669 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4f3cfcd-e632-402e-b566-87dcc8ec1373 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:25.033119 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4f3cfcd-e632-402e-b566-87dcc8ec1373 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:25.060673 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a4f3cfcd-e632-402e-b566-87dcc8ec1373 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:45:25.135012 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a4f3cfcd-e632-402e-b566-87dcc8ec1373 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 204 len: 0 microversion: 2.1 time: 0.126933 Jul 21 08:45:25.136051 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 566/1125] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:45:25 2022] DELETE /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:45:25.142205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0b98903-69f7-4879-8793-43a24506dca0] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 08:45:25.142809 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=20 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:25.143585 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=40 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:25.148114 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-171b1fac-242a-4c19-9a79-90dc5ba1150f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:25.148838 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-171b1fac-242a-4c19-9a79-90dc5ba1150f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:25.156936 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-171b1fac-242a-4c19-9a79-90dc5ba1150f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:25.157394 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-171b1fac-242a-4c19-9a79-90dc5ba1150f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:25.158173 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-171b1fac-242a-4c19-9a79-90dc5ba1150f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:25.158604 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-171b1fac-242a-4c19-9a79-90dc5ba1150f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:25.344665 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-171b1fac-242a-4c19-9a79-90dc5ba1150f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:25.352544 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-171b1fac-242a-4c19-9a79-90dc5ba1150f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1576 microversion: 2.1 time: 0.212251 Jul 21 08:45:25.353101 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 560/1126] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:25 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:26.370180 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-03cd4b8d-0615-4804-af58-764df10d34e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:26.370873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-03cd4b8d-0615-4804-af58-764df10d34e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:26.381139 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03cd4b8d-0615-4804-af58-764df10d34e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:26.381585 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03cd4b8d-0615-4804-af58-764df10d34e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:26.382363 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03cd4b8d-0615-4804-af58-764df10d34e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:26.382801 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03cd4b8d-0615-4804-af58-764df10d34e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:26.388816 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef3f4090-1fda-4082-90a2-a99f7b11fb9c] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 58408. Jul 21 08:45:26.565413 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-03cd4b8d-0615-4804-af58-764df10d34e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:26.572919 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-03cd4b8d-0615-4804-af58-764df10d34e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1576 microversion: 2.1 time: 0.206923 Jul 21 08:45:26.573479 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 567/1127] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:26 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:26.816360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:45:26.816626 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Thu Jul 21 08:45:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:45:27.542065 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-81bf1cc3-64d0-42b6-b0be-b277d77dfd4b req-6395d59e-8667-44c4-acf0-469e420080e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7256d5-2b57-4efb-82e5-f5b4f5212957", "name": "network-vif-deleted", "tag": "fd9ef0af-7935-422c-b2d2-2df96319c66b"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:45:27.557760 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0b98903-69f7-4879-8793-43a24506dca0] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 58420. Jul 21 08:45:27.562617 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-81bf1cc3-64d0-42b6-b0be-b277d77dfd4b req-6395d59e-8667-44c4-acf0-469e420080e3 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:27.563061 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-81bf1cc3-64d0-42b6-b0be-b277d77dfd4b req-6395d59e-8667-44c4-acf0-469e420080e3 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:27.576870 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-81bf1cc3-64d0-42b6-b0be-b277d77dfd4b req-6395d59e-8667-44c4-acf0-469e420080e3 service nova] Creating event network-vif-deleted:fd9ef0af-7935-422c-b2d2-2df96319c66b for instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 on hv-cinder-85032 Jul 21 08:45:27.582078 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-81bf1cc3-64d0-42b6-b0be-b277d77dfd4b req-6395d59e-8667-44c4-acf0-469e420080e3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044078 Jul 21 08:45:27.583098 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 561/1128] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:45:27.598105 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e47374d2-f4df-44cf-b695-cb2bb44c87de tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:27.598729 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e47374d2-f4df-44cf-b695-cb2bb44c87de tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:27.606765 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47374d2-f4df-44cf-b695-cb2bb44c87de tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:27.607226 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47374d2-f4df-44cf-b695-cb2bb44c87de tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:27.608069 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47374d2-f4df-44cf-b695-cb2bb44c87de tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:27.608503 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47374d2-f4df-44cf-b695-cb2bb44c87de tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:27.685321 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e47374d2-f4df-44cf-b695-cb2bb44c87de tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:27.694353 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e47374d2-f4df-44cf-b695-cb2bb44c87de tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 200 len: 1224 microversion: 2.1 time: 0.107926 Jul 21 08:45:27.695159 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 568/1129] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:27 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:28.712190 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:28.712892 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:28.719602 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:28.720049 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:28.720824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:28.721257 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:28.734492 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] HTTP exception thrown: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Request method failure captured: Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 HTTP/1.1 Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RGNVVxypoz-H-Azhf8JRnED1jV6T-hzJWEoI_UJIW6DIvFSk9YLYCkkh3VYiHyD4dFSlavqPXd7158-e8-7dBh2CMMekz_docjU55yiEPXdA5fgdFsr9dBSmLIhwv-uPA5ifmPfTcX-1IxURoi25xI1TMLowVCu_z_6YOfaKB_6eog Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:45:28.736151 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7858221a62ef4997979bd2c376629140"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7858221a62ef4997979bd2c376629140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-755086540 Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 855719ced58a4b55b4b8d31affd62a7b Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:45:28.737909 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2d7256d5-2b57-4efb-82e5-f5b4f5212957'} Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:45:28.744667 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:45:28.747060 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:45:28.748562 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Returning 404 to user: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:45:28.748562 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-793434f1-8dff-43c0-95dd-235cc55c521f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 404 len: 111 microversion: 2.1 time: 0.029728 Jul 21 08:45:28.748562 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 562/1130] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:28 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:45:28.785181 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1008461254", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-48847000", "security_groups": [{"name": "tempest-secgroup-smoke-689971273"}], "block_device_mapping_v2": [{"uuid": "5e9c3bbc-abcf-47c5-9083-5b38d9f679c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cda42cb-310c-4f74-8948-81ed402cc1f6"}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:45:28.899840 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] validate_networks() for [('3cda42cb-310c-4f74-8948-81ed402cc1f6', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:45:29.271722 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:45:29.272197 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:45:29.272677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:45:29.273089 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:45:29.273502 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:45:29.282374 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:29.282823 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:29.283665 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:29.284106 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:29.301048 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Getting quotas for project 7858221a62ef4997979bd2c376629140. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:45:29.304976 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Getting quotas for user 855719ced58a4b55b4b8d31affd62a7b and project 7858221a62ef4997979bd2c376629140. Resources: {'cores', 'ram', 'instances'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:45:29.362306 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:45:29.364416 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e9c3bbc-abcf-47c5-9083-5b38d9f679c9',volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:45:29.493379 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fa806830-9a97-46dd-982d-b3cc665d63c7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712111 Jul 21 08:45:29.494029 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 569/1131] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:45:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:45:29.504119 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7fe50eda-a9ad-4b68-8668-f58235c6662c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:29.504732 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7fe50eda-a9ad-4b68-8668-f58235c6662c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:29.560093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7fe50eda-a9ad-4b68-8668-f58235c6662c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:29.568028 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7fe50eda-a9ad-4b68-8668-f58235c6662c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1093 microversion: 2.1 time: 0.067927 Jul 21 08:45:29.568621 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 563/1132] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:29 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:30.585959 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4a5f906f-5926-4794-95bc-9e9c19d9030f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:30.586576 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4a5f906f-5926-4794-95bc-9e9c19d9030f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:30.592745 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a5f906f-5926-4794-95bc-9e9c19d9030f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:30.593179 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a5f906f-5926-4794-95bc-9e9c19d9030f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:30.593936 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a5f906f-5926-4794-95bc-9e9c19d9030f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:30.594364 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a5f906f-5926-4794-95bc-9e9c19d9030f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:30.656168 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4a5f906f-5926-4794-95bc-9e9c19d9030f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:30.665782 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4a5f906f-5926-4794-95bc-9e9c19d9030f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1209 microversion: 2.1 time: 0.084526 Jul 21 08:45:30.666583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 570/1133] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:30 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:31.682483 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd88b4c5-6211-4b9a-9bf8-17600ccd9ecf tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:31.683205 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd88b4c5-6211-4b9a-9bf8-17600ccd9ecf tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:31.691263 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd88b4c5-6211-4b9a-9bf8-17600ccd9ecf tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:31.691906 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd88b4c5-6211-4b9a-9bf8-17600ccd9ecf tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:31.692797 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd88b4c5-6211-4b9a-9bf8-17600ccd9ecf tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:31.693365 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd88b4c5-6211-4b9a-9bf8-17600ccd9ecf tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:31.812996 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-b4bd00a5-e40b-458b-b403-6b817f885b33 req-06e332b6-ea5d-4c88-8b35-1c23b4f80524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099664ac-435c-4b79-979c-82e88642032a", "tag": "1946f992-1262-4baf-a9d3-09c0607a35db"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:45:31.839875 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-b4bd00a5-e40b-458b-b403-6b817f885b33 req-06e332b6-ea5d-4c88-8b35-1c23b4f80524 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:31.840238 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-b4bd00a5-e40b-458b-b403-6b817f885b33 req-06e332b6-ea5d-4c88-8b35-1c23b4f80524 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:31.859066 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-b4bd00a5-e40b-458b-b403-6b817f885b33 req-06e332b6-ea5d-4c88-8b35-1c23b4f80524 service nova] Creating event network-changed:1946f992-1262-4baf-a9d3-09c0607a35db for instance 099664ac-435c-4b79-979c-82e88642032a on hv-cinder-85032 Jul 21 08:45:31.864404 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-b4bd00a5-e40b-458b-b403-6b817f885b33 req-06e332b6-ea5d-4c88-8b35-1c23b4f80524 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063319 Jul 21 08:45:31.865729 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 571/1134] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:45:31.938844 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd88b4c5-6211-4b9a-9bf8-17600ccd9ecf tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:31.948317 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd88b4c5-6211-4b9a-9bf8-17600ccd9ecf tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.269715 Jul 21 08:45:31.948995 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 564/1135] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:31 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:32.965622 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c14b17cb-377a-4e8f-8b50-7627186f85f0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:32.966323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c14b17cb-377a-4e8f-8b50-7627186f85f0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:32.972484 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c14b17cb-377a-4e8f-8b50-7627186f85f0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:32.972927 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c14b17cb-377a-4e8f-8b50-7627186f85f0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:32.973681 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c14b17cb-377a-4e8f-8b50-7627186f85f0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:32.974112 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c14b17cb-377a-4e8f-8b50-7627186f85f0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:33.123606 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c14b17cb-377a-4e8f-8b50-7627186f85f0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:33.131368 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c14b17cb-377a-4e8f-8b50-7627186f85f0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.170599 Jul 21 08:45:33.131938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 572/1136] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:32 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:34.147985 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2bb2936-e37c-40a2-b0a2-b9acd98c6472 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:34.148591 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2bb2936-e37c-40a2-b0a2-b9acd98c6472 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:34.155178 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2bb2936-e37c-40a2-b0a2-b9acd98c6472 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:34.155651 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2bb2936-e37c-40a2-b0a2-b9acd98c6472 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:34.156401 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2bb2936-e37c-40a2-b0a2-b9acd98c6472 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:34.156828 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2bb2936-e37c-40a2-b0a2-b9acd98c6472 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:34.289246 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2bb2936-e37c-40a2-b0a2-b9acd98c6472 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:34.297093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2bb2936-e37c-40a2-b0a2-b9acd98c6472 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.153014 Jul 21 08:45:34.297646 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 565/1137] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:34 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:35.314680 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d90da37b-a3d2-42df-8075-03e29fc705ce tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:35.315675 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d90da37b-a3d2-42df-8075-03e29fc705ce tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:35.322450 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d90da37b-a3d2-42df-8075-03e29fc705ce tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:35.322906 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d90da37b-a3d2-42df-8075-03e29fc705ce tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:35.323704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d90da37b-a3d2-42df-8075-03e29fc705ce tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:35.324144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d90da37b-a3d2-42df-8075-03e29fc705ce tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:35.457540 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d90da37b-a3d2-42df-8075-03e29fc705ce tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:35.465618 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d90da37b-a3d2-42df-8075-03e29fc705ce tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.155769 Jul 21 08:45:35.466192 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 573/1138] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:35 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:36.486407 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7fc97f12-9e89-45bd-bfa3-237a3e6558ac tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:36.487083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7fc97f12-9e89-45bd-bfa3-237a3e6558ac tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:36.494713 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fc97f12-9e89-45bd-bfa3-237a3e6558ac tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:36.495152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fc97f12-9e89-45bd-bfa3-237a3e6558ac tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:36.495942 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fc97f12-9e89-45bd-bfa3-237a3e6558ac tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:36.496376 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fc97f12-9e89-45bd-bfa3-237a3e6558ac tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:36.629768 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7fc97f12-9e89-45bd-bfa3-237a3e6558ac tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:36.637203 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7fc97f12-9e89-45bd-bfa3-237a3e6558ac tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.154947 Jul 21 08:45:36.637766 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 566/1139] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:36 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:37.653105 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-109c65e0-df30-4564-8686-829598e74374 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:37.653711 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-109c65e0-df30-4564-8686-829598e74374 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:37.660218 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-109c65e0-df30-4564-8686-829598e74374 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:37.660664 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-109c65e0-df30-4564-8686-829598e74374 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:37.661417 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-109c65e0-df30-4564-8686-829598e74374 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:37.661848 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-109c65e0-df30-4564-8686-829598e74374 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:37.795620 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-109c65e0-df30-4564-8686-829598e74374 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:37.803061 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-109c65e0-df30-4564-8686-829598e74374 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.153838 Jul 21 08:45:37.803659 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 574/1140] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:37 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:38.820865 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3a297e63-8c7b-4728-a5b3-ad999517aa83 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:38.821470 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3a297e63-8c7b-4728-a5b3-ad999517aa83 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:38.828363 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a297e63-8c7b-4728-a5b3-ad999517aa83 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:38.828727 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a297e63-8c7b-4728-a5b3-ad999517aa83 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:38.829490 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a297e63-8c7b-4728-a5b3-ad999517aa83 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:38.829953 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a297e63-8c7b-4728-a5b3-ad999517aa83 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:38.962323 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a297e63-8c7b-4728-a5b3-ad999517aa83 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:38.969799 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3a297e63-8c7b-4728-a5b3-ad999517aa83 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.153364 Jul 21 08:45:38.970370 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 567/1141] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:38 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:39.985975 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fcd00609-4b8d-4c2a-8280-72f7d2453efc tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:39.986600 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fcd00609-4b8d-4c2a-8280-72f7d2453efc tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:39.989505 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:39.990468 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:39.996195 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcd00609-4b8d-4c2a-8280-72f7d2453efc tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:39.996648 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcd00609-4b8d-4c2a-8280-72f7d2453efc tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:39.997464 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcd00609-4b8d-4c2a-8280-72f7d2453efc tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:39.997905 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcd00609-4b8d-4c2a-8280-72f7d2453efc tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:40.136669 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fcd00609-4b8d-4c2a-8280-72f7d2453efc tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:40.144111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fcd00609-4b8d-4c2a-8280-72f7d2453efc tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.161986 Jul 21 08:45:40.144686 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 575/1142] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:39 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:41.161478 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f3847e1a-5c78-4161-9ef7-163b29539e42 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:41.162092 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f3847e1a-5c78-4161-9ef7-163b29539e42 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:41.164580 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:41.170182 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3847e1a-5c78-4161-9ef7-163b29539e42 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:41.170629 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3847e1a-5c78-4161-9ef7-163b29539e42 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:41.171413 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3847e1a-5c78-4161-9ef7-163b29539e42 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:41.171847 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3847e1a-5c78-4161-9ef7-163b29539e42 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:41.301083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f3847e1a-5c78-4161-9ef7-163b29539e42 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:41.309021 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f3847e1a-5c78-4161-9ef7-163b29539e42 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.151441 Jul 21 08:45:41.309579 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 568/1143] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:41 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:41.677905 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-d14fe7f3-fc0a-4876-810d-2dfd4c43889c req-9b6d447a-3cfa-4533-b136-238d1c44114f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099664ac-435c-4b79-979c-82e88642032a", "name": "network-vif-plugged", "status": "completed", "tag": "1946f992-1262-4baf-a9d3-09c0607a35db"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:45:41.687126 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-d14fe7f3-fc0a-4876-810d-2dfd4c43889c req-9b6d447a-3cfa-4533-b136-238d1c44114f service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:41.687696 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-d14fe7f3-fc0a-4876-810d-2dfd4c43889c req-9b6d447a-3cfa-4533-b136-238d1c44114f service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:41.699558 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-d14fe7f3-fc0a-4876-810d-2dfd4c43889c req-9b6d447a-3cfa-4533-b136-238d1c44114f service nova] Creating event network-vif-plugged:1946f992-1262-4baf-a9d3-09c0607a35db for instance 099664ac-435c-4b79-979c-82e88642032a on hv-cinder-85032 Jul 21 08:45:41.704532 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-d14fe7f3-fc0a-4876-810d-2dfd4c43889c req-9b6d447a-3cfa-4533-b136-238d1c44114f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030430 Jul 21 08:45:41.705119 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 576/1144] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:45:42.326369 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6dad4a0-7e50-44f4-8df9-9db201d0614e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:42.326923 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b6dad4a0-7e50-44f4-8df9-9db201d0614e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:42.333457 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6dad4a0-7e50-44f4-8df9-9db201d0614e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:42.333907 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6dad4a0-7e50-44f4-8df9-9db201d0614e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:42.334669 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6dad4a0-7e50-44f4-8df9-9db201d0614e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:42.335104 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6dad4a0-7e50-44f4-8df9-9db201d0614e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:42.463729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b6dad4a0-7e50-44f4-8df9-9db201d0614e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:42.471287 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b6dad4a0-7e50-44f4-8df9-9db201d0614e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1264 microversion: 2.1 time: 0.148820 Jul 21 08:45:42.471883 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 569/1145] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:42 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:43.489433 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-be5216e6-9362-4e07-960d-d897cc4b4a5b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:43.490169 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-be5216e6-9362-4e07-960d-d897cc4b4a5b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:43.496702 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be5216e6-9362-4e07-960d-d897cc4b4a5b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:43.497152 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be5216e6-9362-4e07-960d-d897cc4b4a5b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:43.497929 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be5216e6-9362-4e07-960d-d897cc4b4a5b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:43.498373 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be5216e6-9362-4e07-960d-d897cc4b4a5b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:43.629968 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be5216e6-9362-4e07-960d-d897cc4b4a5b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:43.638100 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-be5216e6-9362-4e07-960d-d897cc4b4a5b tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1452 microversion: 2.1 time: 0.153406 Jul 21 08:45:43.638677 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 577/1146] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:43 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:43.654000 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-099183d4-6472-4b5f-8a1a-7ca9fe522d78 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:45:43.654613 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-099183d4-6472-4b5f-8a1a-7ca9fe522d78 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:45:43.661000 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-099183d4-6472-4b5f-8a1a-7ca9fe522d78 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:43.661443 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-099183d4-6472-4b5f-8a1a-7ca9fe522d78 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:43.662203 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-099183d4-6472-4b5f-8a1a-7ca9fe522d78 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:43.662633 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-099183d4-6472-4b5f-8a1a-7ca9fe522d78 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:43.795499 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-099183d4-6472-4b5f-8a1a-7ca9fe522d78 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:45:43.803006 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-099183d4-6472-4b5f-8a1a-7ca9fe522d78 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1452 microversion: 2.1 time: 0.152806 Jul 21 08:45:43.803607 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 570/1147] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:45:43 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:45:45.669279 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-cea4a44e-33be-4d8c-a11b-146f5aaf5001 req-6528230b-4f2d-4444-9366-917bdfe4422a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099664ac-435c-4b79-979c-82e88642032a", "tag": "1946f992-1262-4baf-a9d3-09c0607a35db"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:45:45.678698 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-cea4a44e-33be-4d8c-a11b-146f5aaf5001 req-6528230b-4f2d-4444-9366-917bdfe4422a service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:45:45.679148 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-cea4a44e-33be-4d8c-a11b-146f5aaf5001 req-6528230b-4f2d-4444-9366-917bdfe4422a service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:45:45.690278 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-cea4a44e-33be-4d8c-a11b-146f5aaf5001 req-6528230b-4f2d-4444-9366-917bdfe4422a service nova] Creating event network-changed:1946f992-1262-4baf-a9d3-09c0607a35db for instance 099664ac-435c-4b79-979c-82e88642032a on hv-cinder-85032 Jul 21 08:45:45.696135 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-cea4a44e-33be-4d8c-a11b-146f5aaf5001 req-6528230b-4f2d-4444-9366-917bdfe4422a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029883 Jul 21 08:45:45.696733 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 578/1148] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:46:19.594134 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:46:19.594901 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Thu Jul 21 08:46:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:47:10.321313 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:47:10.321915 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:47:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:47:19.427378 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=24 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:19.428685 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=52 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:19.433023 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1515072020", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-48847000", "security_groups": [{"name": "tempest-secgroup-smoke-689971273"}], "block_device_mapping_v2": [{"uuid": "e8a6686e-1119-47e0-91ab-e0554cd57367", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cda42cb-310c-4f74-8948-81ed402cc1f6"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:47:19.542975 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] validate_networks() for [('3cda42cb-310c-4f74-8948-81ed402cc1f6', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 08:47:19.976630 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 08:47:19.977056 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 08:47:19.977528 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 08:47:19.977931 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 08:47:19.978339 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 08:47:19.987191 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:19.987662 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:19.988456 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:19.988892 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:20.006055 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Getting quotas for project 7858221a62ef4997979bd2c376629140. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 08:47:20.010023 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Getting quotas for user 855719ced58a4b55b4b8d31affd62a7b and project 7858221a62ef4997979bd2c376629140. Resources: {'cores', 'ram', 'instances'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 08:47:20.065900 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 08:47:20.068018 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8a6686e-1119-47e0-91ab-e0554cd57367',volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 08:47:20.195741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d11730e-6550-4a95-b3b8-cf9a207aee1c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769947 Jul 21 08:47:20.196550 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 571/1149] 10.222.0.47 () {60 vars in 1146 bytes} [Thu Jul 21 08:47:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 08:47:20.204511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:20.205277 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:20.209938 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9244a519-dbaa-4879-a53b-c7cee7a07af3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:20.210634 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9244a519-dbaa-4879-a53b-c7cee7a07af3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:20.277735 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9244a519-dbaa-4879-a53b-c7cee7a07af3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:20.284527 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9244a519-dbaa-4879-a53b-c7cee7a07af3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1093 microversion: 2.1 time: 0.081923 Jul 21 08:47:20.285195 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 579/1150] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:20 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:21.301248 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-394e0512-d566-4add-a2f3-073de36e757f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:21.303395 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-394e0512-d566-4add-a2f3-073de36e757f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:21.310512 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394e0512-d566-4add-a2f3-073de36e757f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:21.310957 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394e0512-d566-4add-a2f3-073de36e757f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:21.311745 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394e0512-d566-4add-a2f3-073de36e757f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:21.312174 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-394e0512-d566-4add-a2f3-073de36e757f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:21.399096 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-394e0512-d566-4add-a2f3-073de36e757f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:21.406575 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-394e0512-d566-4add-a2f3-073de36e757f tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1209 microversion: 2.1 time: 0.109132 Jul 21 08:47:21.407153 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 572/1151] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:21 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:22.424291 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-309d3a6e-4104-4f1b-b740-11de897ce5d6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:22.425562 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-309d3a6e-4104-4f1b-b740-11de897ce5d6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:22.433795 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-309d3a6e-4104-4f1b-b740-11de897ce5d6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:22.434528 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-309d3a6e-4104-4f1b-b740-11de897ce5d6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:22.435547 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-309d3a6e-4104-4f1b-b740-11de897ce5d6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:22.436203 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-309d3a6e-4104-4f1b-b740-11de897ce5d6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:22.586773 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-309d3a6e-4104-4f1b-b740-11de897ce5d6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:22.605306 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-309d3a6e-4104-4f1b-b740-11de897ce5d6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.182796 Jul 21 08:47:22.611731 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 580/1152] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:22 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:22.653040 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-ac2ac3f4-ce4f-4265-b1cf-a0eec74243bc req-51b58163-18d7-4315-a8b0-af937fac4770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68fcb133-5d4f-4e78-8f03-8949fdcbb0c9", "tag": "79fe8bee-0cf8-4966-8d07-7f5144af376c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:47:22.661643 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ac2ac3f4-ce4f-4265-b1cf-a0eec74243bc req-51b58163-18d7-4315-a8b0-af937fac4770 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:22.663023 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ac2ac3f4-ce4f-4265-b1cf-a0eec74243bc req-51b58163-18d7-4315-a8b0-af937fac4770 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:22.678005 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-ac2ac3f4-ce4f-4265-b1cf-a0eec74243bc req-51b58163-18d7-4315-a8b0-af937fac4770 service nova] Creating event network-changed:79fe8bee-0cf8-4966-8d07-7f5144af376c for instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 on hv-cinder-85032 Jul 21 08:47:22.683244 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-ac2ac3f4-ce4f-4265-b1cf-a0eec74243bc req-51b58163-18d7-4315-a8b0-af937fac4770 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129784 Jul 21 08:47:22.684489 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 573/1153] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:47:23.625438 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-06f64a25-0408-4b7c-b565-97f51894c5e8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:23.626558 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-06f64a25-0408-4b7c-b565-97f51894c5e8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:23.633658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06f64a25-0408-4b7c-b565-97f51894c5e8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:23.634115 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06f64a25-0408-4b7c-b565-97f51894c5e8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:23.635066 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06f64a25-0408-4b7c-b565-97f51894c5e8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:23.635545 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06f64a25-0408-4b7c-b565-97f51894c5e8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:23.770624 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-06f64a25-0408-4b7c-b565-97f51894c5e8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:23.778133 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-06f64a25-0408-4b7c-b565-97f51894c5e8 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.158669 Jul 21 08:47:23.778699 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 581/1154] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:23 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:24.796355 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb35a4e6-e9b1-450f-a28e-e436fbc7c18c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:24.796959 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb35a4e6-e9b1-450f-a28e-e436fbc7c18c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:24.803237 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb35a4e6-e9b1-450f-a28e-e436fbc7c18c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:24.803719 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb35a4e6-e9b1-450f-a28e-e436fbc7c18c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:24.804486 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb35a4e6-e9b1-450f-a28e-e436fbc7c18c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:24.804919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb35a4e6-e9b1-450f-a28e-e436fbc7c18c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:24.937459 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb35a4e6-e9b1-450f-a28e-e436fbc7c18c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:24.944987 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb35a4e6-e9b1-450f-a28e-e436fbc7c18c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.153433 Jul 21 08:47:24.945551 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 574/1155] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:24 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:25.961983 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-38e1ef33-71e9-4650-b357-578d76f3304a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:25.962633 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-38e1ef33-71e9-4650-b357-578d76f3304a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:25.969204 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38e1ef33-71e9-4650-b357-578d76f3304a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:25.969658 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38e1ef33-71e9-4650-b357-578d76f3304a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:25.970447 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38e1ef33-71e9-4650-b357-578d76f3304a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:25.971015 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38e1ef33-71e9-4650-b357-578d76f3304a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:26.101120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-38e1ef33-71e9-4650-b357-578d76f3304a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:26.108679 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-38e1ef33-71e9-4650-b357-578d76f3304a tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.150729 Jul 21 08:47:26.109248 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 582/1156] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:25 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:27.125965 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f26402fb-476f-49f2-92d5-17b9fc9fa797 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:27.126824 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f26402fb-476f-49f2-92d5-17b9fc9fa797 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:27.133883 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f26402fb-476f-49f2-92d5-17b9fc9fa797 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:27.134326 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f26402fb-476f-49f2-92d5-17b9fc9fa797 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:27.135111 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f26402fb-476f-49f2-92d5-17b9fc9fa797 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:27.135576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f26402fb-476f-49f2-92d5-17b9fc9fa797 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:27.268868 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f26402fb-476f-49f2-92d5-17b9fc9fa797 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:27.276258 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f26402fb-476f-49f2-92d5-17b9fc9fa797 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.154183 Jul 21 08:47:27.276805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 575/1157] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:27 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:28.293053 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2705e5b6-3b06-4f16-9079-e84692d55204 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:28.293672 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2705e5b6-3b06-4f16-9079-e84692d55204 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:28.299732 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2705e5b6-3b06-4f16-9079-e84692d55204 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:28.300186 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2705e5b6-3b06-4f16-9079-e84692d55204 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:28.300946 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2705e5b6-3b06-4f16-9079-e84692d55204 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:28.301382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2705e5b6-3b06-4f16-9079-e84692d55204 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:28.432434 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2705e5b6-3b06-4f16-9079-e84692d55204 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:28.439904 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2705e5b6-3b06-4f16-9079-e84692d55204 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.150946 Jul 21 08:47:28.440483 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 583/1158] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:28 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:29.457255 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3fdd8294-b366-4b76-8876-cfc7942cfedb tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:29.457848 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3fdd8294-b366-4b76-8876-cfc7942cfedb tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:29.464829 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fdd8294-b366-4b76-8876-cfc7942cfedb tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:29.465280 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fdd8294-b366-4b76-8876-cfc7942cfedb tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:29.466083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fdd8294-b366-4b76-8876-cfc7942cfedb tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:29.466560 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fdd8294-b366-4b76-8876-cfc7942cfedb tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:29.601217 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3fdd8294-b366-4b76-8876-cfc7942cfedb tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:29.608656 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3fdd8294-b366-4b76-8876-cfc7942cfedb tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.155466 Jul 21 08:47:29.609221 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 576/1159] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:29 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:30.625156 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5580bed6-4b62-4f07-bfad-0f987f3f19e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:30.625775 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5580bed6-4b62-4f07-bfad-0f987f3f19e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:30.628403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:30.633762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5580bed6-4b62-4f07-bfad-0f987f3f19e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:30.634213 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5580bed6-4b62-4f07-bfad-0f987f3f19e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:30.634984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5580bed6-4b62-4f07-bfad-0f987f3f19e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:30.635453 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5580bed6-4b62-4f07-bfad-0f987f3f19e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:30.780975 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5580bed6-4b62-4f07-bfad-0f987f3f19e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:30.789252 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5580bed6-4b62-4f07-bfad-0f987f3f19e1 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.167962 Jul 21 08:47:30.789819 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 584/1160] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:30 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:31.806279 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15a3b371-a2db-437c-a97e-eb157e78d6b0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:31.806836 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15a3b371-a2db-437c-a97e-eb157e78d6b0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:31.808793 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:31.809449 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:31.815546 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15a3b371-a2db-437c-a97e-eb157e78d6b0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:31.815990 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15a3b371-a2db-437c-a97e-eb157e78d6b0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:31.816751 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15a3b371-a2db-437c-a97e-eb157e78d6b0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:31.817175 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15a3b371-a2db-437c-a97e-eb157e78d6b0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:31.950594 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-15a3b371-a2db-437c-a97e-eb157e78d6b0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:31.957960 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15a3b371-a2db-437c-a97e-eb157e78d6b0 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.156139 Jul 21 08:47:31.958524 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 577/1161] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:31 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:32.260969 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-7804b889-4800-4c43-a574-54f72a24372d req-094d181e-a71d-442d-ac11-c27707ad2e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fcb133-5d4f-4e78-8f03-8949fdcbb0c9", "name": "network-vif-plugged", "status": "completed", "tag": "79fe8bee-0cf8-4966-8d07-7f5144af376c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:47:32.269835 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-7804b889-4800-4c43-a574-54f72a24372d req-094d181e-a71d-442d-ac11-c27707ad2e20 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:32.270323 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-7804b889-4800-4c43-a574-54f72a24372d req-094d181e-a71d-442d-ac11-c27707ad2e20 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:32.282237 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-7804b889-4800-4c43-a574-54f72a24372d req-094d181e-a71d-442d-ac11-c27707ad2e20 service nova] Creating event network-vif-plugged:79fe8bee-0cf8-4966-8d07-7f5144af376c for instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 on hv-cinder-85032 Jul 21 08:47:32.287965 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-7804b889-4800-4c43-a574-54f72a24372d req-094d181e-a71d-442d-ac11-c27707ad2e20 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029966 Jul 21 08:47:32.288563 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 585/1162] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:47:32.974000 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5376da07-8984-423b-a0b4-e7b3a9cdda15 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:32.975100 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5376da07-8984-423b-a0b4-e7b3a9cdda15 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:32.981516 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5376da07-8984-423b-a0b4-e7b3a9cdda15 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:32.981955 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5376da07-8984-423b-a0b4-e7b3a9cdda15 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:32.982701 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5376da07-8984-423b-a0b4-e7b3a9cdda15 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:32.983127 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5376da07-8984-423b-a0b4-e7b3a9cdda15 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:33.115916 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5376da07-8984-423b-a0b4-e7b3a9cdda15 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:33.123217 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5376da07-8984-423b-a0b4-e7b3a9cdda15 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1264 microversion: 2.1 time: 0.153049 Jul 21 08:47:33.123805 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 578/1163] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:32 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:34.141152 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4f26251d-6fdc-4663-8a3a-3201fcae469c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:34.141859 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4f26251d-6fdc-4663-8a3a-3201fcae469c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:34.148187 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f26251d-6fdc-4663-8a3a-3201fcae469c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:34.148636 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f26251d-6fdc-4663-8a3a-3201fcae469c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:34.149402 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f26251d-6fdc-4663-8a3a-3201fcae469c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:34.149843 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f26251d-6fdc-4663-8a3a-3201fcae469c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:34.292983 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4f26251d-6fdc-4663-8a3a-3201fcae469c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:34.300942 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4f26251d-6fdc-4663-8a3a-3201fcae469c tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1451 microversion: 2.1 time: 0.164288 Jul 21 08:47:34.301514 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 586/1164] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:34 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:34.318812 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0bac6210-3c29-42e4-9634-4a1c423e15d7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:47:34.319441 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0bac6210-3c29-42e4-9634-4a1c423e15d7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:47:34.326707 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bac6210-3c29-42e4-9634-4a1c423e15d7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:34.327150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bac6210-3c29-42e4-9634-4a1c423e15d7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:34.327952 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bac6210-3c29-42e4-9634-4a1c423e15d7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:34.328403 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bac6210-3c29-42e4-9634-4a1c423e15d7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:34.459155 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0bac6210-3c29-42e4-9634-4a1c423e15d7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:47:34.466826 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0bac6210-3c29-42e4-9634-4a1c423e15d7 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1451 microversion: 2.1 time: 0.151877 Jul 21 08:47:34.467409 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 579/1165] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:47:34 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:47:36.357327 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a47379db-143a-4705-87e5-44a03f64f9fe req-6a85e8df-1b1c-439b-84d1-e6fdd4efafac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68fcb133-5d4f-4e78-8f03-8949fdcbb0c9", "tag": "79fe8bee-0cf8-4966-8d07-7f5144af376c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:47:36.365758 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a47379db-143a-4705-87e5-44a03f64f9fe req-6a85e8df-1b1c-439b-84d1-e6fdd4efafac service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:47:36.366210 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a47379db-143a-4705-87e5-44a03f64f9fe req-6a85e8df-1b1c-439b-84d1-e6fdd4efafac service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:47:36.377433 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a47379db-143a-4705-87e5-44a03f64f9fe req-6a85e8df-1b1c-439b-84d1-e6fdd4efafac service nova] Creating event network-changed:79fe8bee-0cf8-4966-8d07-7f5144af376c for instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 on hv-cinder-85032 Jul 21 08:47:36.383056 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a47379db-143a-4705-87e5-44a03f64f9fe req-6a85e8df-1b1c-439b-84d1-e6fdd4efafac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029467 Jul 21 08:47:36.383771 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 587/1166] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:48:38.767093 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:48:38.767744 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:48:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:48:46.826868 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:48:46.827486 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Thu Jul 21 08:48:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:49:16.805502 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:49:16.809178 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=20 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:49:16.809923 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=40 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:49:16.811557 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=46 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:49:16.820403 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-3ac354fe-4cf7-4c77-a011-f08b4faa509b req-50e11bce-166b-423d-b230-23cf7c2fe06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68fcb133-5d4f-4e78-8f03-8949fdcbb0c9", "tag": "79fe8bee-0cf8-4966-8d07-7f5144af376c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:49:16.821553 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05d1438e-e2ef-470e-aba6-957e9795c3a3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:16.822076 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05d1438e-e2ef-470e-aba6-957e9795c3a3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:16.830152 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05d1438e-e2ef-470e-aba6-957e9795c3a3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:16.830581 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05d1438e-e2ef-470e-aba6-957e9795c3a3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:16.831571 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05d1438e-e2ef-470e-aba6-957e9795c3a3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:16.831816 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05d1438e-e2ef-470e-aba6-957e9795c3a3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:16.839204 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-3ac354fe-4cf7-4c77-a011-f08b4faa509b req-50e11bce-166b-423d-b230-23cf7c2fe06f service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:16.839204 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-3ac354fe-4cf7-4c77-a011-f08b4faa509b req-50e11bce-166b-423d-b230-23cf7c2fe06f service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:16.850011 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-3ac354fe-4cf7-4c77-a011-f08b4faa509b req-50e11bce-166b-423d-b230-23cf7c2fe06f service nova] Creating event network-changed:79fe8bee-0cf8-4966-8d07-7f5144af376c for instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 on hv-cinder-85032 Jul 21 08:49:16.854689 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-3ac354fe-4cf7-4c77-a011-f08b4faa509b req-50e11bce-166b-423d-b230-23cf7c2fe06f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047277 Jul 21 08:49:16.855418 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 588/1167] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:49:16.861774 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05d1438e-e2ef-470e-aba6-957e9795c3a3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:49:16.950007 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05d1438e-e2ef-470e-aba6-957e9795c3a3 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "DELETE /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 204 len: 0 microversion: 2.1 time: 0.146107 Jul 21 08:49:16.953874 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 580/1168] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:49:16 2022] DELETE /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:49:16.959811 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e27ffbd8-f0e5-4e3e-b739-c8400e452142 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:16.960781 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e27ffbd8-f0e5-4e3e-b739-c8400e452142 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:16.968286 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e27ffbd8-f0e5-4e3e-b739-c8400e452142 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:16.969013 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e27ffbd8-f0e5-4e3e-b739-c8400e452142 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:16.969984 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e27ffbd8-f0e5-4e3e-b739-c8400e452142 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:16.970414 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e27ffbd8-f0e5-4e3e-b739-c8400e452142 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:17.109032 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e27ffbd8-f0e5-4e3e-b739-c8400e452142 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:49:17.116701 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e27ffbd8-f0e5-4e3e-b739-c8400e452142 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1576 microversion: 2.1 time: 0.160988 Jul 21 08:49:17.117423 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 589/1169] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:16 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:49:18.135004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-91e99832-ef32-4599-93c0-3517062f72b6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:18.135874 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-91e99832-ef32-4599-93c0-3517062f72b6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:18.142729 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91e99832-ef32-4599-93c0-3517062f72b6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:18.143201 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91e99832-ef32-4599-93c0-3517062f72b6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:18.143998 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91e99832-ef32-4599-93c0-3517062f72b6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:18.144427 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91e99832-ef32-4599-93c0-3517062f72b6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:18.658184 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-91e99832-ef32-4599-93c0-3517062f72b6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:49:18.665758 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-91e99832-ef32-4599-93c0-3517062f72b6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1576 microversion: 2.1 time: 0.535088 Jul 21 08:49:18.667119 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 581/1170] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:18 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1576 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:49:19.181815 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-e2f88b96-a431-41a6-8a15-3d8aada647c2 req-d27e1885-0680-4cd9-beac-77a1485770fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fcb133-5d4f-4e78-8f03-8949fdcbb0c9", "name": "network-vif-deleted", "tag": "79fe8bee-0cf8-4966-8d07-7f5144af376c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:49:19.192188 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e2f88b96-a431-41a6-8a15-3d8aada647c2 req-d27e1885-0680-4cd9-beac-77a1485770fc service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:19.192627 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e2f88b96-a431-41a6-8a15-3d8aada647c2 req-d27e1885-0680-4cd9-beac-77a1485770fc service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:19.205694 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-e2f88b96-a431-41a6-8a15-3d8aada647c2 req-d27e1885-0680-4cd9-beac-77a1485770fc service nova] Creating event network-vif-deleted:79fe8bee-0cf8-4966-8d07-7f5144af376c for instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 on hv-cinder-85032 Jul 21 08:49:19.211545 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-e2f88b96-a431-41a6-8a15-3d8aada647c2 req-d27e1885-0680-4cd9-beac-77a1485770fc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033392 Jul 21 08:49:19.212265 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 590/1171] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:49:19.684122 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:19.684739 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:19.691430 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:19.691847 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:19.692630 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:19.693062 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:19.723078 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:19.723498 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:19.723940 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lazy-loading 'fault' on Instance uuid 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:49:19.766951 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:49:19.774425 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da09e926-5e5c-4741-a3e9-51738b2f8fb6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 200 len: 1229 microversion: 2.1 time: 0.094788 Jul 21 08:49:19.774999 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 582/1172] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:19 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:49:20.792253 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:20.792873 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:20.799638 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:20.800096 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:20.800868 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:20.801308 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:20.815273 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] HTTP exception thrown: Instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 could not be found. Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Request method failure captured: Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 HTTP/1.1 Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RGNVVxypoz-H-Azhf8JRnED1jV6T-hzJWEoI_UJIW6DIvFSk9YLYCkkh3VYiHyD4dFSlavqPXd7158-e8-7dBh2CMMekz_docjU55yiEPXdA5fgdFsr9dBSmLIhwv-uPA5ifmPfTcX-1IxURoi25xI1TMLowVCu_z_6YOfaKB_6eog Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:49:20.816947 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7858221a62ef4997979bd2c376629140"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7858221a62ef4997979bd2c376629140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 855719ced58a4b55b4b8d31affd62a7b Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 could not be found. Jul 21 08:49:20.818790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '68fcb133-5d4f-4e78-8f03-8949fdcbb0c9'} Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 could not be found. Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:49:20.819854 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 could not be found. Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 could not be found. Jul 21 08:49:20.821628 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:20.823201 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Returning 404 to user: Instance 68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:49:20.823201 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-13a21a3d-0991-4a48-ada7-67149a6e787e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9" status: 404 len: 111 microversion: 2.1 time: 0.030413 Jul 21 08:49:20.823201 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 591/1173] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:20 2022] GET /compute/v2.1/servers/68fcb133-5d4f-4e78-8f03-8949fdcbb0c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:49:23.908083 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c47c5eb7-166c-43ce-b4ca-2b82a3fd44e6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:23.908708 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c47c5eb7-166c-43ce-b4ca-2b82a3fd44e6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:23.911970 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-ea77c4bb-d481-4358-86a2-afab61263bcc req-9fa3f89b-136f-4f7b-97ab-e3d668e188f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099664ac-435c-4b79-979c-82e88642032a", "tag": "1946f992-1262-4baf-a9d3-09c0607a35db"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:49:23.915130 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c47c5eb7-166c-43ce-b4ca-2b82a3fd44e6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:23.915599 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c47c5eb7-166c-43ce-b4ca-2b82a3fd44e6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:23.916365 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c47c5eb7-166c-43ce-b4ca-2b82a3fd44e6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:23.916787 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c47c5eb7-166c-43ce-b4ca-2b82a3fd44e6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:23.924315 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ea77c4bb-d481-4358-86a2-afab61263bcc req-9fa3f89b-136f-4f7b-97ab-e3d668e188f0 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:23.924878 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ea77c4bb-d481-4358-86a2-afab61263bcc req-9fa3f89b-136f-4f7b-97ab-e3d668e188f0 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:23.936977 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-ea77c4bb-d481-4358-86a2-afab61263bcc req-9fa3f89b-136f-4f7b-97ab-e3d668e188f0 service nova] Creating event network-changed:1946f992-1262-4baf-a9d3-09c0607a35db for instance 099664ac-435c-4b79-979c-82e88642032a on hv-cinder-85032 Jul 21 08:49:23.942399 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-ea77c4bb-d481-4358-86a2-afab61263bcc req-9fa3f89b-136f-4f7b-97ab-e3d668e188f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035008 Jul 21 08:49:23.942623 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c47c5eb7-166c-43ce-b4ca-2b82a3fd44e6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 08:49:23.943952 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 592/1174] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 08:49:24.032914 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c47c5eb7-166c-43ce-b4ca-2b82a3fd44e6 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "DELETE /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 204 len: 0 microversion: 2.1 time: 0.128141 Jul 21 08:49:24.034360 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 583/1175] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:49:23 2022] DELETE /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 08:49:24.043680 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a16cbdb9-d232-446d-a262-4430617a9a5e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:24.044396 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a16cbdb9-d232-446d-a262-4430617a9a5e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:24.051316 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a16cbdb9-d232-446d-a262-4430617a9a5e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:24.051790 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a16cbdb9-d232-446d-a262-4430617a9a5e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:24.052775 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a16cbdb9-d232-446d-a262-4430617a9a5e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:24.053216 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a16cbdb9-d232-446d-a262-4430617a9a5e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:24.202563 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a16cbdb9-d232-446d-a262-4430617a9a5e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:49:24.210333 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a16cbdb9-d232-446d-a262-4430617a9a5e tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1577 microversion: 2.1 time: 0.171742 Jul 21 08:49:24.210916 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 593/1176] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:24 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:49:25.228226 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-890b17ec-45f3-4b8e-8231-bb11b7100e07 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:25.228929 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-890b17ec-45f3-4b8e-8231-bb11b7100e07 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:25.237877 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-890b17ec-45f3-4b8e-8231-bb11b7100e07 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:25.238498 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-890b17ec-45f3-4b8e-8231-bb11b7100e07 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:25.242468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-890b17ec-45f3-4b8e-8231-bb11b7100e07 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:25.242468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-890b17ec-45f3-4b8e-8231-bb11b7100e07 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:25.440913 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-890b17ec-45f3-4b8e-8231-bb11b7100e07 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:49:25.448692 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-890b17ec-45f3-4b8e-8231-bb11b7100e07 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1577 microversion: 2.1 time: 0.224734 Jul 21 08:49:25.449406 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 584/1177] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:25 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 08:49:26.081469 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-1f7640d7-49aa-4e16-81b8-0590df13f300 req-1ab7bd1b-8802-4763-970c-e9913f7858e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099664ac-435c-4b79-979c-82e88642032a", "name": "network-vif-deleted", "tag": "1946f992-1262-4baf-a9d3-09c0607a35db"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 08:49:26.090142 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-1f7640d7-49aa-4e16-81b8-0590df13f300 req-1ab7bd1b-8802-4763-970c-e9913f7858e9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:26.090704 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-1f7640d7-49aa-4e16-81b8-0590df13f300 req-1ab7bd1b-8802-4763-970c-e9913f7858e9 service nova] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:26.102583 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-1f7640d7-49aa-4e16-81b8-0590df13f300 req-1ab7bd1b-8802-4763-970c-e9913f7858e9 service nova] Creating event network-vif-deleted:1946f992-1262-4baf-a9d3-09c0607a35db for instance 099664ac-435c-4b79-979c-82e88642032a on hv-cinder-85032 Jul 21 08:49:26.107770 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-1f7640d7-49aa-4e16-81b8-0590df13f300 req-1ab7bd1b-8802-4763-970c-e9913f7858e9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029930 Jul 21 08:49:26.108371 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 594/1178] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Jul 21 08:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 08:49:26.466348 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:26.467175 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:26.474309 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:26.474806 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:26.475564 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:26.476004 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:26.513475 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:26.513916 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:26.514404 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lazy-loading 'fault' on Instance uuid 099664ac-435c-4b79-979c-82e88642032a {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 08:49:26.559426 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855719ced58a4b55b4b8d31affd62a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858221a62ef4997979bd2c376629140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 08:49:26.566849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1288a090-940a-4bf6-95b4-c5b880a5f727 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 200 len: 1229 microversion: 2.1 time: 0.104350 Jul 21 08:49:26.567413 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 585/1179] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:26 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 08:49:27.585259 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:27.585958 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 099664ac-435c-4b79-979c-82e88642032a] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:27.592108 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:27.592559 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:27.593326 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:27.593764 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:27.606925 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] HTTP exception thrown: Instance 099664ac-435c-4b79-979c-82e88642032a could not be found. Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Request method failure captured: Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a HTTP/1.1 Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RGNVVxypoz-H-Azhf8JRnED1jV6T-hzJWEoI_UJIW6DIvFSk9YLYCkkh3VYiHyD4dFSlavqPXd7158-e8-7dBh2CMMekz_docjU55yiEPXdA5fgdFsr9dBSmLIhwv-uPA5ifmPfTcX-1IxURoi25xI1TMLowVCu_z_6YOfaKB_6eog Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:49:27.608561 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7858221a62ef4997979bd2c376629140"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7858221a62ef4997979bd2c376629140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 855719ced58a4b55b4b8d31affd62a7b Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 099664ac-435c-4b79-979c-82e88642032a could not be found. Jul 21 08:49:27.610439 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '099664ac-435c-4b79-979c-82e88642032a'} Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 099664ac-435c-4b79-979c-82e88642032a could not be found. Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:49:27.611391 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 099664ac-435c-4b79-979c-82e88642032a could not be found. Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 099664ac-435c-4b79-979c-82e88642032a could not be found. Jul 21 08:49:27.612990 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:27.614460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Returning 404 to user: Instance 099664ac-435c-4b79-979c-82e88642032a could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:49:27.614460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-910e2c3d-fdde-4a1b-a882-d25e939f30f9 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a" status: 404 len: 111 microversion: 2.1 time: 0.029573 Jul 21 08:49:27.614460 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 595/1180] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:27 2022] GET /compute/v2.1/servers/099664ac-435c-4b79-979c-82e88642032a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:49:28.047993 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:28.048576 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:28.054688 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:28.055132 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:28.055919 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:28.056347 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:28.069952 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] HTTP exception thrown: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Request method failure captured: Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 HTTP/1.1 Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept: application/json Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Connection: close Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Host: 10.222.0.47 Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABi2RGNVVxypoz-H-Azhf8JRnED1jV6T-hzJWEoI_UJIW6DIvFSk9YLYCkkh3VYiHyD4dFSlavqPXd7158-e8-7dBh2CMMekz_docjU55yiEPXdA5fgdFsr9dBSmLIhwv-uPA5ifmPfTcX-1IxURoi25xI1TMLowVCu_z_6YOfaKB_6eog Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jul 21 08:49:28.071652 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7858221a62ef4997979bd2c376629140"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7858221a62ef4997979bd2c376629140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Id: 855719ced58a4b55b4b8d31affd62a7b Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: method: > Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: exception: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.073495 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: action_args: {'id': '2d7256d5-2b57-4efb-82e5-f5b4f5212957'} Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:49:28.074496 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.076282 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.077970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Returning 404 to user: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:49:28.077970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0a349f8-7ac1-4d5e-afab-8e7a940e6781 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 404 len: 111 microversion: 2.1 time: 0.028847 Jul 21 08:49:28.077970 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 586/1181] 10.222.0.47 () {58 vars in 1238 bytes} [Thu Jul 21 08:49:28 2022] DELETE /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:49:28.081787 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:28.082411 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] [instance: 2d7256d5-2b57-4efb-82e5-f5b4f5212957] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 08:49:28.088690 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:28.089143 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:28.089924 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 08:49:28.090360 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Lock "ace4bd78-5500-4e99-9aa8-321e61ee020f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 08:49:28.104833 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] HTTP exception thrown: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Request method failure captured: Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 HTTP/1.1 Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept: application/json Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Connection: close Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Host: 10.222.0.47 Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABi2RGNVVxypoz-H-Azhf8JRnED1jV6T-hzJWEoI_UJIW6DIvFSk9YLYCkkh3VYiHyD4dFSlavqPXd7158-e8-7dBh2CMMekz_docjU55yiEPXdA5fgdFsr9dBSmLIhwv-uPA5ifmPfTcX-1IxURoi25xI1TMLowVCu_z_6YOfaKB_6eog Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jul 21 08:49:28.106382 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7858221a62ef4997979bd2c376629140"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7858221a62ef4997979bd2c376629140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7858221a62ef4997979bd2c376629140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 7858221a62ef4997979bd2c376629140 Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestVolumeBootPattern-755086540 Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Id: 855719ced58a4b55b4b8d31affd62a7b Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestVolumeBootPattern-755086540-project Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: method: > Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: exception: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.108144 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: action_args: {'id': '2d7256d5-2b57-4efb-82e5-f5b4f5212957'} Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 08:49:28.109120 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. Jul 21 08:49:28.110762 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jul 21 08:49:28.112495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Returning 404 to user: Instance 2d7256d5-2b57-4efb-82e5-f5b4f5212957 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 08:49:28.112495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7dba636a-945e-40f2-8dd8-fc7c3035ef55 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957" status: 404 len: 111 microversion: 2.1 time: 0.029911 Jul 21 08:49:28.112495 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 596/1182] 10.222.0.47 () {58 vars in 1235 bytes} [Thu Jul 21 08:49:28 2022] GET /compute/v2.1/servers/2d7256d5-2b57-4efb-82e5-f5b4f5212957 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 08:49:29.405468 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e43306af-8146-41d0-9231-98092c404602 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] Calling method '.version_select at 0x7f65c0ae0ca0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 08:49:29.427741 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e43306af-8146-41d0-9231-98092c404602 tempest-TestVolumeBootPattern-755086540 tempest-TestVolumeBootPattern-755086540-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-48847000" status: 202 len: 0 microversion: 2.1 time: 0.026554 Jul 21 08:49:29.428471 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 587/1183] 10.222.0.47 () {58 vars in 1256 bytes} [Thu Jul 21 08:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-48847000 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 08:49:39.604685 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:49:39.605264 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Thu Jul 21 08:49:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:50:30.330849 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:50:30.331473 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:50:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:51:58.775599 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:51:58.776277 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:51:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:52:06.835300 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:52:06.835913 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Thu Jul 21 08:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:52:25.566454 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:52:25.566988 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:52:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:52:27.668959 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:52:27.669511 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Thu Jul 21 08:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:52:59.613111 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:52:59.613772 dv-cinder-850320-1-iscsi devstack@n-api.service[117950]: Thu Jul 21 08:52:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 08:53:50.339599 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 08:53:50.340150 dv-cinder-850320-1-iscsi devstack@n-api.service[117951]: Thu Jul 21 08:53:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!